Pascal explained that while he typically ignores negative comments relating to his work, being hurt by backlash sometimes 'comes with the territory'