Further evidence that psychopathology networks have limited replicability and utility: Response to Borsboom et al. (2017) and Steinley et al. (2017)

Abstract

In our target article, we tested the replicability of 4 popular psychopathology network estimation methods that aim to reveal causal relationships among symptoms of mental illness. We started with the focal data set from the 2 foundational psychopathology network papers (i.e., the National Comorbidity Survey-Replication) and identified the National Survey of Mental Health and Wellbeing as a close methodological match for comparison. We compared the psychopathology networks estimated in each data set-as well as in 10 sets of random split-halves within each data set-with the goal of quantifying the replicability of the network parameters as they are interpreted in the extant psychopathology network literature. We concluded that current psychopathology network methods have limited replicability both within and between samples and thus have limited utility. Here we respond to the 2 commentaries on our target article, concluding that the findings of Steinley, Hoffman, Brusco, and Sher (2017)-along with other recent developments in the literature-provide further conclusive evidence that psychopathology networks have poor replicability and utility.