A Practitioner’s Guide to Performing a Holistic Evaluation of Technology-Enhanced Learning in Medical Education

Abstract

Technology-enhanced learning (TEL) is now a common mode of educational delivery within medical education. Despite this upsurge, there remains a paucity in comprehensive evaluation of TEL efficacy. In order to make meaningful and evidence-informed decisions on ‘how’ and ‘when’ to utilise technology within a course, ‘useful knowledge’ is required to support faculty in these decision-making processes. In this monograph, a series of pragmatic and achievable approaches for conducting a holistic evaluation of a TEL resource intervention are detailed. These suggestions are based on an established TEL evaluation framework, as well as the author’s own experience and that of the broader literature. The approaches cover development of an appropriate research question that is based on the availability of existing TEL resources alongside the peer-reviewed literature; the development of an appropriate team as well as recommendations for navigating ethical approval; conducting small-scale quantitative and qualitative measure; and performing a large-scale mixed methods assessment to understand the holistic impact of the TEL resource.