Gaynor previously faced criticism from The View when the hosts sought to speak for her after she said she was not a feminist