Costner and Baumgartner (pictured in 2004) split in May 2023 following a 19 year marriage and three children - with Baumgartner sparking up a romance with the handsome financier, 49, that year