Sam was also in attendance after his mortifying' gaffe with King Charles during at Buckingham Palace on Wednesday was revealed