Cross-institutional outcome prediction for head and neck cancer patients using self-attention neural networks

20Citations
Citations of this article
62Readers
Mendeley users who have this article in their library.

Abstract

In radiation oncology, predicting patient risk stratification allows specialization of therapy intensification as well as selecting between systemic and regional treatments, all of which helps to improve patient outcome and quality of life. Deep learning offers an advantage over traditional radiomics for medical image processing by learning salient features from training data originating from multiple datasets. However, while their large capacity allows to combine high-level medical imaging data for outcome prediction, they lack generalization to be used across institutions. In this work, a pseudo-volumetric convolutional neural network with a deep preprocessor module and self-attention (PreSANet) is proposed for the prediction of distant metastasis, locoregional recurrence, and overall survival occurrence probabilities within the 10 year follow-up time frame for head and neck cancer patients with squamous cell carcinoma. The model is capable of processing multi-modal inputs of variable scan length, as well as integrating patient data in the prediction model. These proposed architectural features and additional modalities all serve to extract additional information from the available data when availability to additional samples is limited. This model was trained on the public Cancer Imaging Archive Head–Neck-PET–CT dataset consisting of 298 patients undergoing curative radio/chemo-radiotherapy and acquired from 4 different institutions. The model was further validated on an internal retrospective dataset with 371 patients acquired from one of the institutions in the training dataset. An extensive set of ablation experiments were performed to test the utility of the proposed model characteristics, achieving an AUROC of 80 % , 80 % and 82 % for DM, LR and OS respectively on the public TCIA Head–Neck-PET–CT dataset. External validation was performed on a retrospective dataset with 371 patients, achieving 69 % AUROC in all outcomes. To test for model generalization across sites, a validation scheme consisting of single site-holdout and cross-validation combining both datasets was used. The mean accuracy across 4 institutions obtained was 72 % , 70 % and 71 % for DM, LR and OS respectively. The proposed model demonstrates an effective method for tumor outcome prediction for multi-site, multi-modal combining both volumetric data and structured patient clinical data.

References Powered by Scopus

Deep residual learning for image recognition

174362Citations
N/AReaders
Get full text

Going deeper with convolutions

39605Citations
N/AReaders
Get full text

Densely connected convolutional networks

28584Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Artificial intelligence to predict outcomes of head and neck radiotherapy

24Citations
N/AReaders
Get full text

Is Attention all You Need in Medical Image Analysis? A Review

13Citations
N/AReaders
Get full text

Current status and future developments in predicting outcomes in radiation oncology

11Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Le, W. T., Vorontsov, E., Romero, F. P., Seddik, L., Elsharief, M. M., Nguyen-Tan, P. F., … Kadoury, S. (2022). Cross-institutional outcome prediction for head and neck cancer patients using self-attention neural networks. Scientific Reports, 12(1). https://doi.org/10.1038/s41598-022-07034-5

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 8

53%

Researcher 4

27%

Professor / Associate Prof. 2

13%

Lecturer / Post doc 1

7%

Readers' Discipline

Tooltip

Computer Science 4

29%

Engineering 4

29%

Medicine and Dentistry 4

29%

Pharmacology, Toxicology and Pharmaceut... 2

14%

Article Metrics

Tooltip
Social Media
Shares, Likes & Comments: 1

Save time finding and organizing research with Mendeley

Sign up for free