Shifts in the Assessment of Problem Solving

Abstract

In recent decades, the types of problems encountered in daily life have changed considerably. In particular, the technology-based society of today increasingly requires people to deal with dynamically changing, intransparent, and complex problems that cannot be solved only by applying factual knowledge. Moreover, in education and at work, such complex problems often need to be addressed collaboratively. Problem solving skills belong to the skills needed to successfully master such problems and are therefore considered to be crucial in the twenty-first century, but we can differentiate between problem solving on an individual level and collaborative problem solving. In the first part of this chapter, we provide insight into individual complex problem solving (CPS) research, with a special focus on its assessment. Specifically, we elaborate on different computer-based approaches to the measurement of CPS and their benefits and limitations. On the basis of the results of various empirical studies, we describe to which extent the CPS assessment has an added value in explaining the scholastic achievement and offer insights into a particular development of the assessment of this skill in large-scale educational contexts. Specifically, we elaborate on the assessment of CPS in the most influential large-scale project worldwide – the Programme for International Student Assessment (PISA) – and illustrate the process by describing example tasks. Further, we elaborate on how research on CPS has expanded towards the conceptually related skill of collaborative problem solving (ColPS) and discuss specific challenges in its assessment. With respect to the recent inclusion of ColPS in large-scale assessments, we present the assessment approach of another large-scale worldwide project – The Assessment and Teaching of Twenty-first Century Skills (ATC21S) – and describe how ColPS was assessed in the PISA 2015 cycle. Finally, we outline the importance of problem solving concepts in general and CPS specifically for future research, and discuss open research questions in this field.