The 2014 Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) Part II: Psychometric Adequacy for Categorical Measurement of Selected DSM-5 Disorders

Abstract

Objectives: To compare the reliability and convergent validity of parent assessments from the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID—a structured diagnostic interview) and the Ontario Child Health Study Emotional Behavioural Scales (OCHS-EBS) symptom checklist for classifying conduct disorder (CD), conduct disorder or oppositional defiant disorder (CD-ODD), attention-deficit hyperactivity disorder (ADHD), major depressive disorder (MDD), generalized anxiety disorder (GAD), and separation anxiety disorder (SAD) based on DSM-5 criteria. Methods: Data came from 283 parent-youth dyads aged 9 to 18 years. Parents and youth completed the assessments separately on 2 different occasions 7 to 14 days apart. After converting the OCHS-EBS scale scores to binary disorder classifications, we compare test-retest reliability estimates and use structural equation modelling (SEM) to compare estimates of convergent validity for the same disorders assessed by each instrument. Results: Average test-retest reliabilities based on κ were 0.71 (MINI-KID) and 0.67 (OCHS-EBS). The average β coefficients for 3 latent measures comprising the following indicators—parent perceptions of youth mental health need and impairment, diagnosis of specific disorders based on health professional communications and youth taking prescribed medication, and youth classifications of disorder based on the MINI-KID—were 0.67 (MINI-KID) and 0.69 (OCHS-EBS). Conclusion: The OCHS-EBS and MINI-KID achieve comparable levels of reliability and convergent validity for classifying child psychiatric disorder. The flexibility, low cost, and minimal respondent burden of checklists for classifying disorder make them well suited for studying disorder in the general population and screening in clinical settings.