The pair looked as loved-up as ever on the outing which comes just a few weeks after their lavish wedding