He acknowledged that his actions against Ventura are something he could never forgive another man for doing if the victim was one of his daughters