The singer, 40, and her partner, 50, looked loved-up as they headed to the show hand in hand in their most public and high-profile outing together to date