The happy couple appeared relaxed as they strolled hand-in-hand down the sidewalk after recently celebrating their second anniversary as a couple in August