I can't really say it's an open standard either since proprietary binary data can be embedded that may not be usable by the 'standard' pdf viewer.

Yes, I have had to deal with it on a development slant as well. The open source tools are rare.

Paper records are the reason systems went to databases to store information.

PDF is NOT the swiss army knife of IT-data and never will be.