The Language Instinct, in one section, gives some examples of ways in which an English sentence can be ungrammatical that people nevertheless rarely think of when they think about grammatical mistakes.
One of my favorites was "This sentence has cabbage six words". It's accurate! It's... almost well-formed! You have to fix "This sentence has six words" somehow, right?