Computerized adaptive test using raw responses for item selection: Theoretical results and applications for the up-and-down method

0Citations
Citations of this article
8Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Modern computerized adaptive testing (CAT) is finding applications that contain more intensive assessments, collected over nontraditional devices such as tablets and smartphones. In this paper, we introduce an CAT algorithm that uses raw responses to adaptively select items and does not require updating the ability estimate at every administration of an item. The proposed algorithm is especially useful in adaptive assessment situations in which updating ability estimate at each administration is either not feasible or too costly to implement. Specifically, an a-stratified multistage up-and-down method is proposed as an approximation to the commonly used recursive maximum likelihood estimate (R-MLE). Using Markov chain tools, we derive theoretical results for the statistical properties of the upand-down method. We also report empirical studies for the performance of the proposed method. Both simulation experiments and real data analysis are included. Limitations of the method such as reduced statistical efficiency are also discussed. Overall, despite the limitations, our results show that the up-and-down method is a promising alternative to the classical R-MLE and well-suited for some CAT applications such as ecological momentary assessments.

Cite

CITATION STYLE

APA

Fuh, C. D., Ip, E. H., & Chen, S. H. (2020). Computerized adaptive test using raw responses for item selection: Theoretical results and applications for the up-and-down method. Statistics and Its Interface, 13(3), 317–333. https://doi.org/10.4310/SII.2020.v13.n3.a3

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free