'The stress that all this brought is not good for anyone's health,' said a second insider. 'She doesn't want to harp on about what this might have done for Brandon's health, but it does cross her mind' (pictured with her son Remington in 2024)