I think one of the major reasons is that physicists actually understand math and statistics and from the first year of university learn how to design, run and analyze experiments properly and quantify uncertainty.

This is a big difference to humanities or even biology.