She and her three siblings moved around throughout her childhood for their father's work, before they settled in Southern California