'She's not going to be mean to me. I'm a guest on on the show, right? So, I wouldn't know it from my exchanges,' Carolla explained to Emily Jashinsky on her podcast Tuesday. 'I would know it with how her staff was cowering'