Improving the reporting of P-values generated by randomization methods

Abstract

We increasingly calculate P-values using randomization approaches. Often, it is not possible to consider full evaluation of all possible samples (e.g. permutations or bootstraps) in order to get an exact P-value, so an approximate P-value is calculated across a random sample of these possible samples. We provide methods that allow the uncertainty introduced by this approximation to be compactly and clearly presented. If the recommendations proposed here are adopted, then reviewers and readers of the increasing number of publications using these approaches will be better informed. © 2013 British Ecological Society.