Swift and Gyllenhaal made headlines when they dated for just three months in the fall of 2010, when he was 29 and she was 20