Critics and fans also took issue with a shockingly graphic toilet scene involving Victor Garber's character, art gallery specialist Mark Kasabian