Cavallari wore a black crop top, low waist black jeans and a leather jacket. Her blonde locks were pulled back and hidden beneath an LA Dodgers black bill cap