A fan-favorite from the cast of Summer House just announced that they were quitting the popular Bravo reality show after seven years