Rihanna could also be seen carrying a large yellow tote bag, presumably filled with the evening essentials