Automatic engagement recognition of children within robot-mediated autism therapy

Abstract

This paper describes a work in progress that aims to design automatic engagement recognition of Robot-Mediated Therapy (RMT) tailored for children with a diverse form of Autism Spectrum Disorder (ASD) in co-occurrence with Attention Deficit Hyperactivity Disorder (ADHD) or Delayed Speech Development (DSD). To this end, we utilized videos obtained from RMT sessions of 36 children aged 4-12 years old. The videos were pre-processed to be used for machine learning approaches. Also, by using the OpenPose tool the datapoints of the facial features and body joints were extracted. Based on these results, automatic engagement recognition model is going to be designed.