Neural networks weren't the best models for character recognition, their breakout success was when they started being the best at recognize characters and other images which happened in the late 00's. OCR before then was really bad.

Might be hard to imagine today but back then OCR and image recognition was typically done with normal statistical regression models, and the neural networks they had then were worse than those.