'We've done many films over the years so it just worked out that way, that there was not a lot of discussion, we didn't have to talk about a lot,' he shared