Justin joked, 'And then you guys had a really fun night together,' as Kristin admitted, 'I never f***ed him, just putting that out there'