Measuring scientific reasoning competencies multiple aspects of validity

Abstract

In this chapter, we investigate multiple aspects of validity of test score interpretations from a scientific reasoning competence test, as well as aspects of reliability. Scientific reasoning competencies are defined as the disposition to solve scientific problems in certain situationsby conducting scientific investigations or using scientificmodels. For the purpose of measurement, the first phase of our project focused on the construction of a paper-pencil assessment instrument – the KoWADiS competence test – for the longitudinal assessment of pre-service science teachers’ scientific reasoning competencies over the course of academic studies. In the second phase of our project, we investigated the reliability of the test scores and the validity oftheir interpretations. We used a multimethod approach, addressing several sources of validity evidence. Overall, the results are coherent and support the validity assumptions toa satisfactory degree. The long-term goal is the use of this test to provide empirically sound suggestions for pre-service science teacher education at university level.