From evaluative and endo-evaluative games to causal imputation

Abstract

Evaluating games and their impact has become canonical. Evaluation using a game is less so. This paper investigates how designers of game-based participatory processes can adapt these processes in order to infer valid evaluative conclusions, with minimal disruption and burden to the players. We introduce and compare three approaches to evaluation with and on games used in participatory processes: 1/ the evaluation of the game itself by external means, 2/ endo-evaluative games which include an evaluation of their use and/or impact as part of the game itself, and 3/ evaluative games whose very purpose is evaluation. After providing examples of these three approaches stemming from Wat-A-Game and CappWag, we discuss their challenges and difficulties, particularly in terms of causal attribution. In conclusion, the fact that designers and players have divergent evaluation objectives means that there is no single approach to evaluation, whether for comparing a case before and after, for comparing different groups or cases, or for a single evaluation. Nevertheless, we propose some recommendations for effects tracing.