The dancer and Love Island star finally confirmed that they were dating earlier this week following weeks of frenzied speculation