The blonde wore a nude-toned bra and underwear as she belted out her new tunes with backup dancers around her on stage