Indeed, in Handel's day, only Handel and other rich important folks dressed like Handel.

Fast forward to 1900 and everyone from lords to labourers is walking around wearing a plain suit. You can still tell the difference between the two, but it's subtle rather than ostentatious.