Reliability Generalization of the Problem Solving Inventory: A Meta-Analysis of Cronbach’s Alpha With a Varying-Coefficient Model

Abstract

The current study presents a reliability generalization of the Problem-Solving Inventory (PSI), utilizing the comprehensive Reliability Generalization Meta-Analysis (REGEMA) checklist to ensure a thorough and methodical approach. The PSI, a tool designed to assess individuals’ perceptions of their problem-solving abilities, consists of a total scale and three subscales: problem-solving confidence (PSC), approach-avoidance style (AAS), and personal control (PC). Each subscale evaluates distinct facets of problem-solving appraisal. From an initial pool of 2,196 articles, 123 met the inclusion criteria and were analyzed using a varying-coefficient model to account for the dynamic nature of reliability coefficients across studies. The meta-analysis revealed that the PSI total scores consistently demonstrated excellent reliability, as did the PSC and AAS subscales. Key predictors of reliability for the PSI and PSC included standard deviation, mean age of the sample, and sample type, whereas mean age and the language of inventory administration were key predictors for the PC subscale. The AAS scale’s reliability was notably influenced by the standard deviation of the scores, sample size, and proportion of women in the sample. These insights underscore the critical role of demographic and methodological variables in evaluating an instrument’s reliability across varied contexts. The study findings reinforce the importance of a nuanced approach to psychological measurement with an awareness of how demographic, sample, and cultural factors influence the reliability of psychometric tools.