He previously dated some other high-profile figures, including ex-racing driver Danica Patrick