Designing an Instrument to Evaluate the Prototype of the Learning Management System-based Materials

Abstract

This study aims to design an evaluation instrument for the Learning Management System (LMS)-Based Materials at the Minori Education Center through a user needs-based approach. The Focus Group Discussion (FGD) results identified three main instruments: questionnaire surveys, interview guides, and observation sheets, designed to evaluate LMS from technical, pedagogical, and cultural dimensions. Each instrument involves key indicators such as ease of use, functionality, speed and responsiveness, interactivity, and open feedback. The findings show that an intuitive, stable, and interactive LMS improves learning effectiveness. In addition, the participatory approach through FGD successfully explores the specific needs of users, resulting in relevant and flexible evaluation instruments for use in various educational contexts. Further discussion relates these findings to the literature demonstrating the importance of user engagement in improving the validity and reliability of LMS evaluation. With this approach, the evaluation instrument can identify the strengths and weaknesses of the LMS and provide strategic input for developing a more inclusive and innovative platform. This research contributes significantly to supporting the development of LMS oriented to user needs in the digital education era.