I don't think anyone believes the idea of meritocracy applies to starving homeless slaves.

Luck is often the deciding factor in meritocracy, but we also make our own luck. You can have all the privleges in the world and still end up as a failson, it happens all the time.