While the media personality doesn't talk about his family that often, he has shared small details of his life at home throughout the years