'Somebody said, To what do you attribute your age and physical condition? And I said, I've always exercised. Three days a week, we go to the gym, still. Three days a week,' the star explained