Phypers claims he confronted Richards about the alleged affair, and they decided to stay together. But a July 4th dispute ultimately prompted him to file for divorce; Seen in May