Softly, Softly Catch the Monkey: Innovative Approaches to Measure Socially Sensitive and Complex Issues in Evaluation Research

Abstract

Abstract: Many government program evaluations require capture of information that is hard to measure, of a sensitive nature, and difficult for the respondent to articulate. This article suggests research designs and methodologies to assist in overcoming such problems in evaluation research. Our discussion is illustrated by three evaluation case studies. Suggestions for research design focus on increasing reliability through intersubjective certifiability and the use of triangulated respondent groups, as well as varying the composition of the research team at different stages of the research. Methodological suggestions are for multifaceted research processes, run in parallel and in sequence, to uncover topics on which findings vary and to find information “hidden” in other approaches. Methods for improving recruitment and retention of respondents are also discussed. We conclude by critically evaluating the outcomes of applying these new approaches and discussing the implications of gaining different or new information from adopting such innovative approaches.