Evaluating the Diagnostic Inter-rater Reliability Between Virtual and In-person Sick-call Examinations at a Military Dental Treatment Facility

Abstract

Introduction: Teledentistry, also known as “virtual” dental examinations, is an innovative approach to increasing access to care. The objective of this study was to evaluate the diagnostic inter-rater reliability between virtual and in-person examinations for patients seeking emergency dental care (sick call) at a military dental treatment facility. Materials and Methods: One hundred subjects received both virtual and in-person examinations on the same day, in random order. The virtual examiner and subject were stationed in separate rooms and used only a laptop equipped with a camera, microphone, and speaker to complete the virtual exam. In contrast, the in-person examiner had access to all standard care modalities in a dental treatment room. After the first encounter, the subject proceeded to the corresponding virtual or in-person exam, and both examiners determined a diagnosis. Inter-rater agreement was determined between the two encounters for both diagnosis specialty category and diagnostic code using the Kappa coefficient. Results: The results of the inter-rater analyses showed a Kappa score of 0.644 for the diagnosis specialty category (P < .001) and a Kappa score of 0.714 for diagnostic codes (P < .001). Both analyses indicated “substantial” agreement. Conclusions: We conclude that teledentistry can be an effective tool for determining a diagnosis and improving access to care for dental emergencies at military dental treatment facilities.