Deep Learning-Based Automatic CT Quantification of Coronavirus Disease 2019 Pneumonia: An International Collaborative Study

Abstract

Objective We aimed to develop and validate the automatic quantification of coronavirus disease 2019 (COVID-19) pneumonia on computed tomography (CT) images. Methods This retrospective study included 176 chest CT scans of 131 COVID-19 patients from 14 Korean and Chinese institutions from January 23 to March 15, 2020. Two experienced radiologists semiautomatically drew pneumonia masks on CT images to develop the 2D U-Net for segmenting pneumonia. External validation was performed using Japanese (n = 101), Italian (n = 99), Radiopaedia (n = 9), and Chinese data sets (n = 10). The primary measures for the system's performance were correlation coefficients for extent (%) and weight (g) of pneumonia in comparison with visual CT scores or human-derived segmentation. Multivariable logistic regression analyses were performed to evaluate the association of the extent and weight with symptoms in the Japanese data set and composite outcome (respiratory failure and death) in the Spanish data set (n = 115). Results In the internal test data set, the intraclass correlation coefficients between U-Net outputs and references for the extent and weight were 0.990 and 0.993. In the Japanese data set, the Pearson correlation coefficients between U-Net outputs and visual CT scores were 0.908 and 0.899. In the other external data sets, intraclass correlation coefficients were between 0.949-0.965 (extent) and between 0.978-0.993 (weight). Extent and weight in the top quartile were independently associated with symptoms (odds ratio, 5.523 and 10.561; P = 0.041 and 0.016) and the composite outcome (odds ratio, 9.365 and 7.085; P = 0.021 and P = 0.035). Conclusions Automatically quantified CT extent and weight of COVID-19 pneumonia were well correlated with human-derived references and independently associated with symptoms and prognosis in multinational external data sets.