Attending the event on Thursday at members-only social club, Chez Margaux, Olivia was seen chatting with her new flame outside