The singer, 35, will appear on the next series of the popular chat show which begins on on Friday, September 26 (seen performing on the show in 2019)