Jenner also slipped into light gray trousers as well as a black shirt that was layered with a red corset-styled piece on top