Earlier this month, Caspar was spotted kissing Olivia Wilde in London. They later made their first public outing together at W Magazine's New York Fashion Week party this week