Validation of a Learning Object Review Instrument: Relationship between Ratings of Learning Objects and Actual Learning Outcomes

Abstract

Growing interest in learning objects (LOs) as a means of developing learning materials is leading to mainline LO evaluation methodologies using review instruments, such as evaluation rubrics, to suit various practical purposes. Such evaluation tools give evidence about the design and the value of the LOs, and studies performed with actual users can provide data against which these expectations of the effects of LOs on student achievements in practice can be set. This study pre- sents a validation of a learning object review instrument (LORI) with student users (n=507) of twenty-four LOs used in K-12 environments. The data collected through pre- and post-tests, teachers’ and students’ usability questionnaires, and the LORI revealed some interactions be- tween those variables. However, the LORI ratings, and the usability assessments did not correlate with the learning gains of students. Some implications of these findings are discussed.