The model said it is unduly unfair when Swift and other WAGs receive hate for how their respective partners perform in football games; pictured in September 2023