Pitfalls of “slippery indicators”: the importance of reading between the lines

Abstract

Within the field of social accountability, studies about “community monitoring” have made broad claims about “what works”–or not–in practice, with significant implications for practitioners and policymakers. Interpretation of these findings is complicated when studies rely on “slippery indicators” that do not measure the real-world processes they claim to address. This article illustrates the problem of slippery indicators, which has two main elements. First, some studies rely on indicators that do not actually measure community monitoring. Second, studies that claim to show a failure of community monitoring to deliver improvements may actually show a failure to deliver community monitoring in the first place. While complex research methods may obscure these two related problems, readers can still assess whether studies’ claims are supported by their empirical data by checking whether the findings are grounded in indicators that actually measure what they claim to study.