Victoria Kennedy (pictured in Boston in May, 2017), Ted Kennedy's wife, commented underneath the video confirmed that every family member was invited, but some had other plans to attend