They'll find justification somehow. Like needing a security force to respond to various "concerns", or the "increasingly unstable situation" (at that point in time).
The whole philosophical core of libertarianism is to seek for a minimal set of rules and systems that doesn't evolve into warlordism or any other corrupt power structure. The idea is to maximize individual liberty and keep it that way.