Validation of Setting and Design of Multi-Stage Testing (MST) to Portray Students’ Achievement on Reading Literacy in AKMI 2021

Abstract

This study identifies the appropriateness design in measuring student abilities through multi-stage testing (MST) in the AKMI program. This study is a follow up of the previous study which carried out the calibration process of the items after the try-out process. Items that meet the qualifications are then included in the item bank which is the material for the implementation of the MST. This research conducts a simulation study to identify the effectiveness of the MST design that has been developed as well as alternative designs. The input used in the simulation process is the distribution of students' abilities and items on the question bank and the MST design. The first two aspects were obtained from the preliminary study while the MST design was obtained from the test administrator of AKMI. The results of the analysis show that the MST design with three stages and the scoring procedure using the classical model can produce student score information with high precision.