Benefits of Independent Double Reading in Digital Mammography: A Theoretical Evaluation of All Possible Pairing Methodologies

Abstract

Rationale and Objectives: To establish the efficacy of pairing readers randomly and evaluate the merits of developing optimal pairing methodologies. Materials and Methods: Sensitivity, specificity, and proportion correct were computed for three different case sets that were independently read by 16 radiologists. Performance of radiologists as single readers was compared to expected double reading performance. We theoretically evaluated all possible pairing methodologies. Bootstrap resampling methods were used for statistical analyses. Results: Significant improvements in expected performance for double versus single reading (ie, delta performance)were shown for all performance measures and case-sets (p ≤.003), with overall delta performance across all theoretically possible pairing schemes (n = 10,395)ranging between.05 and.08. Delta performance for the 20 best pairing schemes was significant (p