Warhol's loyalty and true affection just didn't run that deep, summed up by a dismissive eulogy in his book: 'She was a wonderful, beautiful blank'