Implementation Outcomes of Reusable Learning Objects in Health Care Education Across Three Malaysian Universities: Evaluation Using the RE-AIM Framework

Abstract

Background: Current e-learning evaluation focuses on learners’ knowledge gain, satisfaction, perceptions, and attitudes; few assess the implementation outcomes of e-learning resources in teaching and learning. Objective: In this study, we used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to systematically evaluate the implementation outcomes of reusable learning objects (RLOs) in the context of health care education. Methods: This study is a part of the Advancing Co-creation of RLOs to Digitise Healthcare Curriculum (ACoRD) project, wherein we developed and implemented 23 RLOs across 3 Malaysian universities for medical, pharmacy, and biomedical curricula. Implementation and dissemination strategies were employed. Data were collected using a self-administered web-based questionnaire and Google Analytics. Results: This study reports a cumulative RLO access of 7622 users from 48 countries (reach). Users rated RLOs as very helpful (1452/2071, 70.1%) or helpful (601/2071, 29.1%). Preassessments and postassessments showed a significant improvement in the knowledge score (21 RLOs, P