Speaking on The Development by David podcast with David McIntosh, Jimmy said: 'I lost her when I was about 26'