The self-described 'people pleaser' stressed that his self-worth 'comes from having four kids and a good marriage' and nothing else 'that isn't under the roof of my home' (pictured April 24)