'They have a lot of fun together and she loves how chivalrous he is,' a source told Entertainment Tonight of the couple (pictured in 2023 on a date in NYC)