Among the details was the presence of Taylor's private younger brother, Austin Swift, 33, indicating a growing closeness between their families