He paired the outerwear with blue slacks and a brown, leather belt to complete his look as he and his band members performed some of their most popular hits