Joe, 48, and Caitlin, 34, were first linked in September 2023 just a couple of months after news broke that his marriage to Modern Family star Sofia was ending