Schafer's long blond locks and sculpted physique bore a striking resemblance to Alwyn's ex-girlfriend Swift, whom he dated from 2016 to 2023