Joss, who didn't reveal when the domestic relationship was, admitted she attempted to 'leave him many many times' but the situation became more dangerous