Designing formative and adaptive feedback using incremental user models

Abstract

In this work we focus on immediate feedback during technology enhanced assessment. We distinguish two types of feedback: just after answering a test item or just after the completion of a test (cumulative feedback). We identified three challenges related to generation of formative feedback: (1) the lack of information about the user at beginning of the test; (2) the identification of features for the feedback generation on the item level, (3) generation of formative cumulative feedback from limited contextual information. We approach these challenges by creating a user model incrementally from observed user behavior. The conceptual model is validated in an e-learning platform EAGLE targeting information literacy, ICT literacy, and change management in an adult professional learning environment.