Olivia Wilde, 41, (pictured) looked effortlessly chic in a lace vest as she joined Dakota Fanning and Addison Rae at an intimate dinner hosted by W Magazine in California on Friday