Zoe recently revealed that Taylor provided her refuge in her historic $25 million Beverly Hills mansion amid the devastating Los Angeles wildfires earlier this year; Seen with Swift in 2016