For a short time, it seemed like de Armas could be the one for the Hollywood icon and might even be his fourth and final wife