An Application of Classical Test Theory and Many-facet Rasch Measurement in analyzing the reliability of an English test for non-English major graduates

  • Haiyang S
  • 20

    Readers

    Mendeley users who have this article in their library.
  • N/A

    Citations

    Citations of this article.

Abstract

Taking classical test theory (CTT) and many-facet Rasch measurement (MFRM) model as its theoretical basis, this study investigates the reliability of an English test for non-English major graduates by using SPSS and FACETS. The results of the CTT reliability study show that the candidates’ scores of the objective test were not significantly correlated with their scores of the subjective tasks, and the internal consistency of the three subjective tasks was not satisfying, either. The results of the MFRM analysis indicate that it was the two raters’ severity difference in their rating, the varying difficulty levels of the test tasks, and the bias interaction between some students and certain tasks that caused most of the variance in the scores. This demonstrates the necessity of training raters to be not only self-consistent but also coherent and consistent with each other. It also requires systematic study of measurement theory as well as test item writing or test task design techniques on the part of the teachers as item writers or task designers. In addition, it calls upon English teachers’ attention to enhancing students’ comprehensive language skills.

Author-supplied keywords

  • bias analysis
  • classical test theory
  • many-facet rasch measurement
  • reliability

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document

There are no full text links

Authors

  • Sun Haiyang

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free