Evaluation of an AI-Based TB AFB Smear Screening System for Laboratory Diagnosis on Routine Practice

Abstract

The most robust and economical method for laboratory diagnosis of tuberculosis (TB) is to identify mycobacteria acid-fast bacilli (AFB) under acid-fast staining, despite its disadvantages of low sensitivity and labor intensity. In recent years, artificial intelligence (AI) has been used in TB-smear microscopy to assist medical technologists with routine AFB smear microscopy. In this study, we evaluated the performance of a TB automated system consisting of a microscopic scanner and recognition program powered by artificial intelligence and machine learning. This AI-based system can detect AFB and classify the level from 0 to 4+. A total of 5930 smears were evaluated on the performance of this automatic system in identifying AFB in daily lab practice. At the first stage, 120 images were analyzed per smear, and the accuracy, sensitivity, and specificity were 91.3%, 60.0%, and 95.7%, respectively. In the second stage, 200 images were analyzed per smear, and the accuracy, sensitivity, and specificity were increased to 93.7%, 77.4%, and 96.6%. After removing disqualifying smears caused by poor staining quality and smear preparation, the accuracy, sensitivity, and specificity were improved to 95.2%, 85.7%, and 96.9%, respectively. Furthermore, the automated system recovered 85 positive smears initially identified as negative by manual screening. Our results suggested that the automated TB system could achieve higher sensitivity and laboratory efficiency than manual microscopy under the quality control of smear preparation. Automated TB smear screening systems can serve as a screening tool at the first screen before manual microcopy.