Justin dressed casually in a baggy navy outfit but did add a pair of quirky red sunglasses to his look as he and Hailey left the Hollywood hotspot