The 41-year-old actor went for a double denim look as he was getting ready to film a scene, and his clothes appeared oversized and baggy on his thin frame