This is like saying not purposely running into other cars is a just a moral judgment.

It’s not a moral judgment, it’s a foundational element of all functional human societies. If you don’t agree, you should remove yourself from society.