The Connecticut-born actor accessorized with a burnt-orange set of shades for his outing, which included a stop at the dry cleaner's to pick up a few of his clothes