But the 35-year-old pop star will not be stopping by Jimmy Kimmel's controversial late show, which returned to the air last week after a hotly debated suspension