Victoria recalled an 'upsetting' comment from Mel B after she said she didn't want to join the Spice Girls for their reunion tour