The hitmaker layered her outfit a faux fur trimmed jacket and toted her essentials in an oversized suede bag