Earlier this week, Joel was riding in a limo in New York City when he happened upon a pedi-cab that was playing one of his songs