Predicting neurosurgical referral outcomes in patients with chronic subdural hematomas using machine learning algorithms - A multi-center feasibility study

Abstract

Background: Chronic subdural hematoma (CSDH) incidence and referral rates to neurosurgery are increasing. Accurate and automated evidence-based referral decision-support tools that can triage referrals are required. Our objective was to explore the feasibility of machine learning (ML) algorithms in predicting the outcome of a CSDH referral made to neurosurgery and to examine their reliability on external validation. Methods: Multicenter retrospective case series conducted from 2015 to 2020, analyzing all CSDH patient referrals at two neurosurgical centers in the United Kingdom. 10 independent predictor variables were analyzed to predict the binary outcome of either accepting (for surgical treatment) or rejecting the CSDH referral with the aim of conservative management. 5 ML algorithms were developed and externally tested to determine the most reliable model for deployment. Results: 1500 referrals in the internal cohort were analyzed, with 70% being rejected referrals. On a holdout set of 450 patients, the artificial neural network demonstrated an accuracy of 96.222% (94.444-97.778), an area under the receiver operating curve (AUC) of 0.951 (0.927-0.973) and a brier score loss of 0.037 (0.022-0.056). On a 1713 external validation patient cohort, the model demonstrated an AUC of 0.896 (0.878-0.912) and an accuracy of 92.294% (90.952-93.520). This model is publicly deployed: https://medmlanalytics.com/neural-analysis-model/. Conclusion: ML models can accurately predict referral outcomes and can potentially be used in clinical practice as CSDH referral decision making support tools. The growing demand in healthcare, combined with increasing digitization of health records raises the opportunity for ML algorithms to be used for decision making in complex clinical scenarios.