Implementing Learning Analytic Systems in Educational Institutions: The Importance of Transparent Information for User Acceptance

Abstract

Learning analytics (LA) systems have to meet high standards to ensure effective implementation in educational institutions, but knowledge about which factors play the most important role for users is limited. With two studies, we investigate the importance of different attributes of LA systems (Study 1) and the influence of different information fragments (i.e., benefits, drawbacks, and auditing information of the LA system) on users’ (i.e., students and teachers) perceived fairness and attractiveness of the institution (Study 2). In Study 1, we conducted a choice-based conjoint analysis to examine the relative importance of fairness, accuracy, audits, and methods of use. Our results show that both students and teachers consider fairness to be the most important feature. In Study 2, we conducted an experimental video vignette study to examine how different fragments of information influence perceived fairness (i.e., informational justice) and attractiveness of the institution. We show that more information increases students’ and teachers’ acceptance, even when potential drawbacks are communicated, although the results of the teacher sample are less pronounced overall.