Effectiveness, efficiency, engagement: Mapping the impact of pre-lecture quizzes on educational exchange

Abstract

Our study addresses a systemic issue facing higher education - a lack of rigorous educational research alongside new technology-assisted ways of teaching and learning. The issue highlights the disciplinary disconnect as many academics do not research outside their discipline, yet are tasked with educational modernisation through trying out new educational technology. Addressing this issue, we present our conceptual framework, the course transaction space (CT-space), and use it to analyse the impact of an intervention we designed that involved the use of regular online pre-lecture quizzes in a university mathematics course. The aim of the intervention was to optimise the effect of distributed (spaced) practice on long-term retention. Our findings suggest that a relatively small change in course instruction can improve the efficiency and effectiveness of educational exchange. Our analyses of data from multiple sources provide evidence that our intervention resulted in a sustained increase in the frequency of students' engagement with the content, increased attendance of lectures, and improved grades. Additionally, we discuss the impact of our intervention on the quality of student engagement with reference to competence related beliefs and self-efficacy. Finally, we discuss how our intervention can be used in other contexts for supporting an evidencebased approach to teaching and learning.