Null hypothesis significance testing: a short tutorial

Abstract

Although thoroughly criticized, null hypothesis significance testing (NHST) is the statistical method of choice in biological, biomedical and social sciences to investigate if an effect is likely. In this short tutorial, I first summarize the concepts behind the method while pointing to common interpretation errors. I then present the related concepts of confidence intervals, and discuss what should be reported in which context. The goal is to clarify concepts, present statistical issues that researchers face using the NHST framework and propose reporting practices.