Cameron Diaz and her husband Benji Madden looked exhausted when they took their son Cardinal out in New York City on Thursday