The pair rarely crossed paths, posing for a photo together once in 2001, and joining a slew of stars on-stage for The Queen's Golden Jubilee concert the following year