Interpretable Machine Learning to Optimize Early In-Hospital Mortality Prediction for Elderly Patients with Sepsis: A Discovery Study

Abstract

Sepsis-related mortality rates are high among elderly patients, especially those in intensive care units (ICUs). Early prediction of the prognosis of sepsis is critical, as prompt and effective treatment can improve prognosis. Researchers have predicted mortality and the development of sepsis using machine learning algorithms; however, few studies specifically focus on elderly patients with sepsis. This paper proposes a viable model for early prediction of in-hospital mortality among elderly patients diagnosed with sepsis. We extracted patient information from the Medical Information Mart for Intensive Care IV database. We employed several machine learning algorithms to predict the in-hospital mortality of elderly ICU patients with sepsis. The performance of the model was evaluated by using the AUROC and F1 score. Furthermore, the SHAP algorithm was used to explain the model, analyze how the individual features affect the model output, and visualize the Shapley value for a single individual. Our study included 18522 elderly patients, with a mortality of 15.4%. After screening, 59 clinical variables were extracted to develop models. Feature importance analysis showed that age, PO2, RDW, SPO2, WBC, and urine output were significantly related to the in-hospital mortality. According to the results of AUROC (0.871 (95% CI: 0.854-0.888)) and F1 score (0.547 (95% CI: 0.539-0.661)) analyses, the extreme gradient boosting (XGBoost) model outperformed the other models (i.e., LGBM, LR, RF, DT, and KNN). Furthermore, SHAP force analysis illustrated how the constructed model visualized the individualized prediction of death. XGBoost machine learning framework gives good in-hospital mortality prediction of elderly patients with sepsis and can maximize prediction model accuracy. The XGBoost model could be an effective tool to assist doctors in identifying high-risk cases of in-hospital mortality among elderly patients with sepsis. This could be used to create a clinical decision support system in the future.