Reliability of Telepsychiatry Assessments Using the Attention-Deficit/Hyperactivity Disorder Rating Scale-IV for Children With Neurodevelopmental Disorders and Their Caregivers: Randomized Feasibility Study

Abstract

Background: Given the global shortage of child psychiatrists and barriers to specialized care, remote assessment is a promising alternative for diagnosing and managing attention-deficit/hyperactivity disorder (ADHD). However, only a few studies have validated the accuracy and acceptability of these remote methods. Objective: This study aimed to test the agreement between remote and face-to-face assessments. Methods: Patients aged between 6 and 17 years with confirmed Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition diagnoses of ADHD or autism spectrum disorder (ASD) were recruited from multiple institutions. In a randomized order, participants underwent 2 evaluations, face-to-face and remotely, with distinct evaluators administering the ADHD Rating Scale-IV (ADHD-RS-IV). Intraclass correlation coefficient (ICC) was used to assess the reliability of face-to-face and remote assessments. Results: The participants included 74 Japanese children aged between 6 and 16 years who were primarily diagnosed with ADHD (43/74, 58%) or ASD (31/74, 42%). A total of 22 (30%) children were diagnosed with both conditions. The ADHD-RS-IV ICCs between face-to-face and remote assessments showed “substantial” agreement in the total ADHD-RS-IV score (ICC=0.769, 95% CI 0.654-0.849; P