Out of interest, do you have a high sensitivity to noise around you?
I don't live in a particularly big city and when I visit bigger ones I do feel they are noisy. But not noisy enough to wear protection. I do wear protection when I'm on my motorcycle or at a concert or festival.
I can get by without protection, and it's not as though it particularly hurts; but I prefer things quieter, and it improves my mood. I often also wear it when I am working in an office environment with loud HVAC, also improves my mood.
I don't really know what would qualify as high sensitivity.