But the structures necessary to participate: someone's compelled to do something!
Start from nothing, and try to build up a system that at all resembles a democracy, and you're compelling people left and right. Throw in property rights, such as land ownership, and you're compelling people just about 24/7.
Just because you like being able to use the violence of the state to throw people off your lawn doesn't mean that it isn't compelling people to be in a certain place.
>People have a human right to participate in their government, too.
Which is a limit on government's power. That is the essence of the entire Enlightenment philosophy that all this is based.