The former One Direction star, 31, partied into the early hours with pals at Worthy Farm on Saturday (pictured), where he was seen getting very close to the 28-year-old producer