The actor also reflected on fame by explaining, 'It's been an annoyance I've had to always deal with in different degrees, large and small, as I do the things I really want to do'; seen in Mexico earlier this month