The 61-year-old Oscar winner stepped out in a shiny lavender silk shirt that was left partially unbuttoned to reveal some chest hair while holding his 32-year-old girlfriend's hand