Colbert (pictured) took over for Letterman in 2015 and took the show in a decidedly more political direction but despite leading in the ratings, a shrinking late-night landscape led CBS to claim losses in the tens of millions of dollars