'Her music is undeniable. It would be impossible to not know like every one of her songs almost,' he said of Swift's body of work