It's also worth remember that a lot of things we take for granted were very time intensive back in those days, so you genuinely needed those servants if you had a family and wanted to send the children to school. Consider clothing: washing them involved scrubbing against a board by hand, old clothes were mended extensively by hand (factory cloth existed, but was still expensive), non-wrinkle fabrics didn't exist so everything had to be ironed with hot coal irons, etc. No refrigeration or ready meals, so food had to be prepared from scratch all the time.
Of course, the poor had to deal with all this and scratch out a living, which is a major reason why their children were enlisted to help around the house as soon as practical.
Some of it still applies to me. I pay a maid for washing clothes and house cleaning, I go to a tailor for mending clothers, don't iron the clothes though (and they are not wrinkle free), don't have a refrigerator, etc.
I do have an induction stove (for heating milk, cooking rice, etc). I get lunch delivered and rest of the time I cook and sometimes eat out. Plenty of grocery shops here within 5-min walking radius. Refrigerator for me alone would be a huge waste.
Of course, the poor had to deal with all this and scratch out a living, which is a major reason why their children were enlisted to help around the house as soon as practical.