Barbara admitted to feeling 'guilty' when it came to her only child and also stated, 'I didn't realize how tough it was, because she had a mother who was a celebrity'; seen with former President Richard M. Nixon in 1980