^H in ASCII is backspace (move carriage to the left), and ^J is linefeed (move carriage down), so h-j were completely intuitive to people who already knew ASCII (i.e. everybody) and then it just makes sense to continue the row of other cursor movements.

"intuitive" doesn't mean "I was born knowing it"