Back in April, the two stars debuted their relationship as they cozied up together in a photo during Easter weekend; seen in May in Rome