Ramirez, 49, a non-binary star, did not return for season 3, after their character, Che Diaz, was widely criticized as 'annoying' by viewers