The actress - who has been busy promoting the upcoming fourth season of The Morning Show - was seen arriving to The Late Show With Stephen Colbert