Are multiple contrast tests superior to the ANOVA?

Abstract

Multiple contrast tests can be used to test arbitrary linear hypotheses by providing local and global test decisions as well as simultaneous confidence intervals. The ANOVA-F-test on the contrary can be used to test the global null hypothesis of no treatment effect. Thus, multiple contrast tests provide more information than the analysis of variance (ANOVA) by offering which levels cause the significance. We compare the exact powers of the ANOVA-F-test and multiple contrast tests to reject the global null hypothesis. Hereby, we compute their least favorable configurations (LFCs). It turns out that both procedures have the same LFCs under certain conditions. Exact power investigations show that their powers are equal to detect their LFCs. © 2013 Elsevier BV.