The Covenant star showed off his toned physique in a pair of navy blue board shorts and sunglasses