Comparing Statewide and Single-center Data to Predict High-frequency Emergency Department Utilization Among Patients With Asthma Exacerbation

Abstract

Background: Previous studies examining high-frequency emergency department (ED) utilization have primarily used single-center data, potentially leading to ascertainment bias if patients visit multiple centers. The goals of this study were 1) to create a predictive model to prospectively identify patients at risk of high-frequency ED utilization for asthma and 2) to examine how that model differed using statewide versus single-center data. Methods: To track ED visits within a state, we analyzed 2011 to 2013 data from the New York State Healthcare Cost and Utilization Project State Emergency Department Databases. The first year of data (2011) was used to determine prior utilization, 2012 was used to identify index ED visits for asthma and for demographics, and 2013 was used for outcome ascertainment. High-frequency utilization was defined as 4+ ED visits for asthma within 1 year after the index visit. We performed analyses separately for children (age < 21 years) and adults and constructed two models: one included all statewide (multicenter) visits and the other was restricted to index hospital (single-center) visits. Multivariable logistic regression models were developed from potential predictors selected a priori. The final model was chosen by evaluating model performance using Akaike's Information Criterion scores, 10-fold cross-validation, and receiver operating characteristic curves. Results: Among children, high-frequency ED utilization for asthma was observed in 2,417 of 94,258 (2.56%) using all statewide visits, compared to 1,853 of 94,258 (1.97%) for index hospital visits only. Among adults, the corresponding results were 7,779 of 159,874 (4.87%) and 5,053 of 159,874 (3.16%), respectively. In the multicenter visit model, the area under the curve (AUC) from 10-fold cross-validation for children was 0.70 (95% confidence interval [CI] = 0.69–0.72), compared to 0.71 (95% CI = 0.69–0.72) in the single-center visit model. The corresponding AUC results for adults were 0.76 (95% CI = 0.76–0.77) and 0.76 (95% CI = 0.75–0.77), respectively. Conclusion: Data available at the index ED visit can predict subsequent high-frequency utilization for asthma with AUC ranging from 0.70 to 0.76. Model accuracy was similar regardless of whether outcome ascertainment included all statewide visits (multicenter) or was limited to the index hospital (single-center).