What’s on trial? The making of field experiments in international development

Abstract

In the last 20 years, the drive for evidence-based policymaking has been coupled with a concurrent push for the use of randomized controlled trials (RCTs) as the “gold-standard” for generating rigorous evidence on whether or not development interventions work. Drawing on content analysis of 63 development RCTs and 4 years of participant observation, I provide a rich description of the diverse set of actors and the transnational organizational effort required to implement development RCTs and maintain their “scientific status.” Particularly, I investigate the boundary work that proponents of RCTs—also known as randomistas—do to differentiate the purposes and merits of testing development projects from doing them, as a way to bypass the political and ethical problems presented by adopting the experimental method with foreign aid beneficiaries in poor countries. Although randomistas have been mostly successful in differentiating RCTs from the projects evaluated, I also examine cases where they were not able to do so, as a means to highlight the controversies associated with implementing RCTs in international development.