Development of deep learning model and evaluation in real clinical practice of lingual mandibular bone depression (Stafne cyst) on panoramic radiographs

Abstract

Objectives: Lingual mandibular bone depression (LMBD) is a developmental bony defect in the lingual aspect of the mandible that does not require any surgical treatment. It is sometimes confused with a cyst or another radiolucent pathologic lesion on panoramic radiography. Thus, it is important to differentiate LMBD from true pathological radiolucent lesions requiring treatment. This study aimed to develop a deep learning model for the fully automatic differential diagnosis of LMBD from true pathological radiolucent cysts or tumors on panoramic radiographs without a manual process and evaluate the model’s performance using a test dataset that reflected real clinical practice. Methods: A deep learning model using the EfficientDet algorithm was developed with training and validation data sets (443 images) consisting of 83 LMBD patients and 360 patients with true pathological radiolucent lesions. The test data set (1500 images) consisted of 8 LMBD patients, 53 patients with pathological radiolucent lesions, and 1439 healthy patients based on the clinical prevalence of these conditions in order to simulate real-world conditions, and the model was evaluated in terms of accuracy, sensitivity, and specificity using this test data set. Results: The model’s accuracy, sensitivity, and specificity were more than 99.8%, and only 10 out of 1500 test images were erroneously predicted. Conclusion: Excellent performance was found for the proposed model, in which the number of patients in each group was composed to reflect the prevalence in real-world clinical practice. The model can help dental clinicians make accurate diagnoses and avoid unnecessary examinations in real clinical settings.