Expected and observed in-hospital mortality in heart failure patients before and during the COVID-19 pandemic: Introduction of the machine learning-based standardized mortality ratio at Helios hospitals

Abstract

Background: Reduced hospital admission rates for heart failure (HF) and evidence of increased in-hospital mortality were reported during the COVID-19 pandemic. The aim of this study was to apply a machine learning (ML)-based mortality prediction model to examine whether the latter is attributable to differing case mixes and exceeds expected mortality rates. Methods and Results: Inpatient cases with a primary discharge diagnosis of HF non-electively admitted to 86 German Helios hospitals between 01/01/2016 and 08/31/2020 were identified. Patients with proven or suspected SARS-CoV-2 infection were excluded. ML-based models were developed, tuned, and tested using cases of 2016–2018 (n = 64,440; randomly split 75%/25%). Extreme gradient boosting showed the best model performance indicated by a receiver operating characteristic area under the curve of 0.882 (95% confidence interval [CI]: 0.872–0.893). The model was applied on data sets of 2019 and 2020 (n = 28,556 cases) and the hospital standardized mortality ratio (HSMR) was computed as the observed to expected death ratio. Observed mortality rates were 5.84% (2019) and 6.21% (2020), HSMRs based on an individual case-based mortality probability were 100.0 (95% CI: 93.3–107.2; p = 1.000) for 2019 and 99.3 (95% CI: 92.5–106.4; p =.850) for 2020. Within subgroups of age or hospital volume, there were no significant differences between observed and expected deaths. When stratified for pandemic phases, no excess death during the COVID-19 pandemic was observed. Conclusion: Applying an ML algorithm to calculate expected inpatient mortality based on administrative data, there was no excess death above expected event rates in HF patients during the COVID-19 pandemic.