At one point, the Rhode founder leaned forward to adjust the neckline of her suit, later sitting on the board to dangle her long legs over the turquoise water