The actor married Avanti! actress Juliet Mills, 83, in 1980. Though she is nearly 20 years his senior, he said in a 2024 interview that she kept him feeling young