Outcome analyses of educational interventions: a case study of the Swedish “Boost of Technology” intervention

Abstract

In Sweden, there have been multiple large scale interventions to support compulsory school teachers generally and within specific subjects. Due to the costs associated with such interventions it is critical that interim evaluation measures exist which can indicate potential success. Additionally, evaluation measures which can measure the actual impact of interventions relative to their intended aim are also needed as validation tools. The Swedish regional ‘Tekniklyftet’ or ‘Boost of Technology’ project which ran from 2011 to 2013 is presented here as a case study exploring evaluation measures for educational interventions in technology education. Three different evaluation approaches were used as measures of the intended outcomes of the intervention. These included (1) analysing the preconditions which exist in schools for teachers of Technology, (2) analysing the use of local long term technology education planning documents (school work plans) developed during the intervention, and (3) analysing the potential change over time in student performance in Technology based on national grades at the end of compulsory school. The findings gained from each approach indicate that the Boost of Technology project was a success. However, there were shortcomings associated with each approach. They are therefore discussed in the Swedish context with the intention to support future international stakeholders in the evaluation of interventions aspiring to develop technology education.