Avoiding Randomization Failure in Program Evaluation, with Application to the Medicare Health Support Program

  • King G
  • Nielsen R
  • Coberley C
 et al. 
  • 48


    Mendeley users who have this article in their library.
  • 10


    Citations of this article.


We highlight common problems in the application of random treatment assignment in large-scale program evaluation. Random assignment is the defining feature of modern experimental design, yet errors in design, implementation, and analysis often result in real-world applications not benefiting from its advantages. The errors discussed here cover the control of variability, levels of randomization, size of treatment arms, and power to detect causal effects, as well as the many problems that commonly lead to post-treatment bias. We illustrate these issues by identifying numerous serious errors in the Medicare Health Support evaluation and offering recommendations to improve the design and analysis of this and other large-scale randomized experiments.

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • Gary King

  • Richard Nielsen

  • Carter Coberley

  • James E. Pope

  • Aaron Wells

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free