Ireland did not reveal who the 'poisonous' family members were, but she did publicly endure a strained relationship with her father