This latest show of indifference has left David and Victoria deeply worried for Brooklyn, who is now estranged not just from his family but from his maternal and paternal grandparents and extended family too