As they arrived at the venue, the supportive Prince was seen placing a hand on his wife's back, making for a sweet display of affection