Evaluating the validity of a non-invasive assessment procedure

Abstract

Recent developments in serious games allow for in-game adaptations to enhance the learneŕs current cognitive, motivational or emotional state. Providing suitable adaptations requires a valid assessment of the psycho-pedagogical constructs the game should adapt to. An explicit assessment, e.g. by questionnaires occurring repeatedly on the screen, would impair the learneŕs game flow. Therefore, a non-invasive and implicit assessment procedure is required. In the course of the European research project TARGET, we established an assessment procedure which is based on the interpretation of the learneŕs actions in the virtual environment, calledBehavioural Indicators (BIs). A set of 16 BIs has been formulated to assess the learneŕs current emotional, motivational and clearness state. In this present work, we describe how these BIs can be validated and focus on the innovative elements of the methodological procedure, the material, experiential considerations and the statistical analysis to be applied in an empirical study. © 2012 Springer-Verlag.