Hilary Duff looked radiant as she enjoyed a casual outing with her youngest child, marking a rare sighting of the star just months after welcoming her fourth baby