Earlier this month, a source told People that the pair, who first sparked dating rumors over a coffee date back in 2021, called it quits