As of late, the source said the pair started to realize that they weren't growing together anymore and had become 'stuck in their own ways'