Despite Hailey allegedly not being interested in Justin at the time, she explained in an interview with the chat show host Jimmy Fallon that, following their introduction, her father Stephen and Justins mother, Pattie, kind of just connected as friends