Design and validation of an observation instrument for mathematics classes in secondary education: Expert panel and Delphi process

Abstract

Observation and interpretation processes are rarely used in teaching practice as learning tools in Spain. In order to encourage their use, it is important to have instruments that facilitate analysis in practice and that gather information about the particular characteristics of the educational context in which they are used. The present study presents the process of design, construction and validation of POEMat.ES, an observation and interpretation instrument for use in relation to the teaching of secondary education mathematics classes. This process consisted of two phases: 1) literature review and design using an expert panel made up of 24 specialists; 2) construction and validation via the Delphi method conducted by 15 experts over two rounds. The final version of the tool was organized around three dimensions: mathematical content, didactics of mathematical content and classroom management. It comprised 17 indicators, each of which was classified according to four levels. The methodology applied conformed to consensus, with this being considered adequate for the selection and validation of the indicators that frame the observation of teaching practice. I can be concluded that POEMat.ES is a useful tool for systematizing the observation of teaching practice in order to understand and accurately interpret the process of teaching mathematics in secondary education in the Spanish context.