The astonishing episode comes two days after Scott broke his silence after Kelley announced their split in a cryptic Instagram post; Scott seen in May