The musician, 28, recently 'went public' with producer Jim E-Stack, 33, with the pair (pictured together) reportedly packing on the PDA at Glastonbury over the weekend