Ms Rowling looked surprised at one point when a guest started speaking to her during the races