A rasch-based validation of the evaluation rubric for consecutive interpreting performance

Abstract

The present study is aimed at developing and validating a rubric for consecutive interpreting performance. Firstly, the researchers interviewed with interpreting experts and teachers to identify the factors involved in assessing student performance on consecutive interpreting. Then they designed an interpreting evaluation checklist including 38 items based on the commonalities that emerged from the interviews. Rasch Measurement determined that 25 items of the checklist fitted the Rasch model. Following this, the researchers constructed 25 items in a Likert-type scale with four levels. Having employed the rubric to measure 105 homogeneous interpreting student performance on consecutive interpreting, Factor Analysis revealed the presence of seven factors with eigenvalues greater than 1.0, which accounted for 77% of the variance. At the final stage, SEM results indicated a good fit to the data. The final rubric consisted of four factors with 22 items. The study offers practical implications for interpreting students and teachers.