eModeration: The validation of a user experience evaluation framework

Abstract

The effective, efficient and secure moderation of examination scripts can become challenging when the moderators are geographically dispersed. Despite innovative technological developments and the potential benefits, the use of eModeration (online moderation of examination scripts) in the South African Higher Education Institutions (HEIs) context is limited. Various factors contribute to the adoption of eModeration in HEIs, ranging from human factors to technical issues and organisational resistance to change. The focus of this study is on the human factors involved in eModeration (specifically the user experience) and the research is guided by the following question: What are the most important constructs in evaluating a user experience evaluation framework for eModeration within the context of Higher Education Institutions in South Africa? The research uses a design science research methodology, which includes the design, development and testing of a User Experience Evaluation Framework for eModeration, and the focus of this paper is on the validation phase. The data generation methods include interviews with management from two South African HEIs. The contribution of this paper is to propose a validated framework for evaluating eModeration in higher education and demonstrate how that can be used by managers in HEIs to guide the selection and evaluation of eModeration systems towards facilitating more effective learning environments.