Despite his departure, Lee has fond memories of being on the show, and called his co-star Parker 'the nicest person I've ever met'; Seen with Parker on set in NYC in 2021