It was confirmed earlier this month that the singer and TV personality are dating after first crossing paths on Celebrity Big Brother U.K. a few months earlier in April