Insiders said the final straw for Prince William were claims made his younger brother made in memoir, Spare, including that they had physically fought over Harry's relationship with Meghan (William and Harry are pictured together in June 2021)