For their day at the amusement park, the couple coordinated in white T-shirts and light wash jeans. The pair appeared attached at the hip as they enjoyed a loved-up outing to kick off the weekend