There has long been a common method used in science and social sciences when deciding whether results are worth publishing. One starts out with what is called the ‘null hypothesis’, a kind of baseline that might represent (say) the current conventional wisdom, and then one sees if the results of the experiment are consistent with it. If it is not consistent, then the results are considered to be more interesting than if they were. This requires the use of statistics and then one has the problem of deciding whether the result is a real effect or a statistical anomaly. For a long time, something called the ‘p-value’ was used to make this decision and a p-value of 0.05 was used as the benchmark for statistical significance.
[Read more…]