The mystery man, sporting just swim trunks and sneakers in addition to a life vest, was seen staring at her with a smile on his face multiple times during their time together