He explained that her visit to the infamous island owned by the disgraced financier was not for anything untoward; pictured February 2000 in New York City