Improving measurement in health education and health behavior research using item response modeling: comparison with the classical test theory approach

  • Wilson M
  • Allen D
  • Li J
 et al. 
  • 1


    Mendeley users who have this article in their library.
  • N/A


    Citations of this article.


This paper compares the approach and resultant outcomes of item response models (IRMs) and classical test theory (CTT). First, it reviews basic ideas of CTT, and compares them to the ideas about using IRMs introduced in an earlier paper. It then applies a comparison scheme based on the AERA/APA/NCME 'Standards for Educational and Psychological Tests' to compare the two approaches under three general headings: (i) choosing a model; (ii) evidence for reliability--incorporating reliability coefficients and measurement error--and (iii) evidence for validity--including evidence based on instrument content, response processes, internal structure, other variables and consequences. An example analysis of a self-efficacy (SE) scale for exercise is used to illustrate these comparisons. The investigation found that there were (i) aspects of the techniques and outcomes that were similar between the two approaches, (ii) aspects where the item response modeling approach contributes to instrument construction and evaluation beyond the classical approach and (iii) aspects of the analysis where the measurement models had little to do with the analysis or outcomes. There were no aspects where the classical approach contributed to instrument construction or evaluation beyond what could be done with the IRM approach. Finally, properties of the SE scale are summarized and recommendations made.

Author-supplied keywords

  • *Data Interpretation
  • *Health Behavior
  • *Health Education
  • *Psychological Theory
  • *Research Design/statistics & numerical data
  • Educational
  • Exercise
  • Humans
  • Models
  • Psychometrics/instrumentation/methods
  • Reproducibility of Results
  • Self Efficacy
  • Statistical
  • article
  • comparative study
  • devices
  • educational model
  • exercise
  • health behavior
  • health education
  • human
  • methodology
  • psychological theory
  • psychometry
  • reproducibility
  • self concept
  • statistical analysis
  • statistics

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • M Wilson

  • D D Allen

  • J C Li

  • Wilson M.

  • Allen D.D.

  • Li J.C.

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free