Last Friday, the Secret of Us songstress performed her new single Crazy Girl at BST Hyde Park in London while sporting the same exact Boston Red Sox cap that the Oscar-nominated actor had worn at Glastonbury