This makes me think it'd be handy to embed git into a desktop application and use it as the datastore. But I suppose the GPL prevents this unless the app is open source.
Embedding git the application (or even the library) itself can be difficult, as shown by github's experience [0] (I guess they know what they're talking about).
What you can do, on the other hand, is use the git format. There's already something pure-python [0] and something pure-go [1], and I'm pretty sure the same exists for other languages.
Oh and by the way, the pure-python I linked to is used for bup, a backup tool that stores its data in git format. Because it's extremely efficient.