Later at the billionaire bash, Bloom ditched his outfit for a tank top and shorts, showing off his sculpted physique perhaps sending a subtle message to his ex about what shes missing