The chart-topping star's set also featured performances of Ballad of a Homeschooled Girl, Vampire and Drivers Licence, the 2021 single that proved to be a turning point in Olivia's career