Amid his upcoming season 51 return, Bowen (pictured first row, third from left in 2022) said he felt unsure about his position on the long-running late night comedy show