Reducing the options to divine or arbitrary is a false dilemma. Math is discovered/invented by humans, but it is far from arbitrary.

A slave will appeal to society because society has the power. But if the society does not listen to the appeals of the slave, we can still judge that the slave is correct and the society is wrong. And that judgement is not arbitrary.