The Nedelsky standard setting procedure utilizes an option elimination strategy to estimate the probability that a minimally competent candidate (MCC) will answer a multiple-choice item correctly. The purpose of this study was to investigate the accuracy of predicted item performance from the Nedelsky ratings. The results indicate that test taking behavior of MCCs does not match the underlying Nedelsky assumption that MCCs randomly guess among the options judges believe should be attractive. Further, the accuracy of predicted item performance appears to vary as a function of item difficulty and content domain. However, an analysis of the relationship between judges' rating of distractor difficulty and proportion of examinees selecting item distractors indicated that useful information about examinee item performance is obtainable from Nedelsky-based judgments.
CITATION STYLE
Melican, G. J., Mills, C. N., & Plake, B. S. (1989). Accuracy of Item Performance Predictions Based on the Nedelsky Standard Setting Method. Educational and Psychological Measurement, 49(2), 467–478. https://doi.org/10.1177/0013164489492020
Mendeley helps you to discover research relevant for your work.