How Robust are Health Plan Quality Indicators to Data Loss? A Monte Carlo Simulation Study of Pediatric Asthma Treatment

  • B. S
  • P.K. S
  • L.S. M
  • 1


    Mendeley users who have this article in their library.
  • N/A


    Citations of this article.


Objectives. (1) To test the robustness of a health plan quality indicator (QI) for persistent asthma to various forms of data loss and (2) to assess the implications of the findings for other health plan quality measures. Data Sources/Study Settings. Maryland Medicaid fee-for-service (FFS) claims. Children with asthma (n = 5,804) were selected from Medicaid enrollment records and medical and pharmacy FFS claims filed between June 1996 and December 1997. Study Design. A variant of a HEDIS measure for treatment of persistent asthma (the percent of asthma patients filling two or more rescue medications who also filled a controller medication) was selected to test the robustness of proportion-based QIs to loss of data. Data loss was simulated through a series of Monte Carlo experiments. Data Collection/Extraction Methods. Merged FFS medical and prescription claims. Principal Findings. The asthma QI measure was highly robust to systematic and random data loss. The measure declined by less than 2 percent in the presence of up to a 35 percent data loss. Redundancy in the numerator of the QI significantly increased the robustness of the measure to data loss. Conclusions. A HEDIS-related QI measure for persistent asthma is robust to data loss. The findings suggest that other proportion-based quality indicators, particularly those in which plan members have multiple opportunities to meet the numerator criterion, are likely to reflect true levels of health plan quality in the face of incomplete data capture.

Author-supplied keywords

  • *asthma
  • *health care quality
  • *health insurance
  • Monte Carlo method
  • United States
  • article
  • child
  • human
  • information processing
  • major clinical study
  • medicaid
  • prescription
  • simulation

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • Stuart B.

  • Singhal P.K.

  • Magder L.S.

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free