The Developing and Calibration of PhysEDiTHOTS Based on IRT and IQF for Students' HOTS Diagnostic

Abstract

This research aims at developing a diagnostic test based on Item Response Theory (IRT) to measure the weakness of physics students' ability in higher order thinking skills (PhysEDiTHOTS) and to find out the characteristics of PhysEDiTHOTS. The instrument is esssay test developed from the sub-aspects of higher order thinking skills and sub-materials of fundamental physics based on Indonesian Qualification Framework (IQF). The instrument comprises 24 valid items according to physics experts, physics education experts, and the experts of the measurement of physics education, which is analyzed using Aiken's V (0.92 to 1.00). The instrument was tested on 271 students of Physiscs Education Department, The Faculty of Mathematics and Natural Sciences, Yogyakarta State University. The students were choosen using proportinal random sampling techiques considering students level of study, i.e. first, third and fifth semester. The response is polytomus data in four categories that were analyzed according to Partial Credit Model (PCM). The research result shows that the 24 items of PhysEDiTHOTS fit to PCM with a reliability coefficient of 0.77, a difficulty index ranging between-0.97 and 1.87, as well as based on the information function and SEM, convey that PhysEDiTHOTS can be appropriately used to measure weakness in higher order thinking skills among students whose range of ability from-1.6 to 3.0. Therfore, PhysEDiTHOTS is an instrument that is good and appropriate to measure the weakness of physics students' higher order thinking skills.