The Wolverine actor showcased his gym-toned figure in a fitted navy polo that clung to his muscular frame, black athletic shorts and matching sneakers