'They both wanted a family. It wasn't that one wanted it more than the other,' an insider revealed to Us Weekly on Wednesday effective striking down the speculation that having children together was a potential sticking point between the two (seen in Pari