Human action recognition aims at extracting features on top of human skeletons and estimating human pose. It has received increasing attention in recent years. However, existing methods capture only the action information while in a real world application such as cognitive assessment, we need to measure the executive functioning that helps psychiatrists to identify some mental disease such as Alzheimer, Schizophrenia and ADHD. In this paper, we propose a skeleton-based action recognition named Mind-In-Action (MIA) for cognitive assessment. MIA integrates a pose estimator to extract the human body joints and then automatically measures the executive functioning employing the distance and elbow angle calculation. Three score functions were designed to measure the executive functioning: the accuracy score, the rhythm score and the functioning score. We evaluate our model on two different datasets and show that our approach significantly outperforms the existing methods.
CITATION STYLE
Elmi, S., Navuluru, S. K., & Bell, M. (2023). Mind in Action: Cognitive Assessment Using Action Recognition. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 14146 LNCS, pp. 534–539). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-39847-6_44
Mendeley helps you to discover research relevant for your work.