One month before tying the knot, the pair seemingly went public with their relationship when they were spotted in London together after her performance at the Leeds Festival