At one point, Perry could be seen holding a lighthearted conversation with the little one while sitting on a comfy lounge chair