Development, Reliability, and Validity of Open-ended Test to Measure Student’s Digital Literacy Skill

Abstract

Thisstudy aims to developing open-ended test for measuring digital literacy skills of students. There are three step of this study, it was defining the construc and formatting objectives, validity by expert review and item administration. The open-ended test was develop based on five components of digital literacy skill: information, communication, content creation, safety, and problem-solving. The open-ended test was initially piloted on four group of samples: interviews and validity by physics expert (2 Professor, 1 Doctoral), professional teachers (N=2), and college students of graduate school (N=2). Modification were made afterwards and the test was administered to a group of science students from high school in Yogyakarta province, Indonesia (N=129). Result of this study are: (1) The open-ended test instrumen proved valid and worthy of use to measure digital literacy skill; (2) Based on expert validation, the teset is valid with CVR value 1.00; (3) the average value and standard deviation of INFIT MNSQ is .83-1.21 (fit with rasch model/good item); (4) The item has a good degree of difficulty with range of difficulty level between (moderate level). The student’s digital literacy skill test can also be used to measure student’s skill with very low to excellentcategories