Michael held Kitty's hand as he helped off the small boat once they arrived at the French beach club