Emma who is the niece of Julia Roberts recalled 'coming out here all the time' to visit her mom Kelly Cunningham who now lives in the Hamptons full time