A method based on interpretable machine learning for recognizing the intensity of human engagement intention

Abstract

To interact with humans more precisely and naturally, social robots need to “perceive” human engagement intention, especially need to recognize the main interaction person in multi-person interaction scenarios. By analyzing the intensity of human engagement intention (IHEI), social robots can distinguish the intention of different persons. Most existing research in this field mainly focus on analyzing whether a person has the intention to interact with the robot while lack of analysis of IHEI. In this regard, this paper proposes an approach for recognizing the engagement intention intensity. Four categories of visual features, including line of sight, head pose, distance and expression of human, are captured, and a CatBoost-based machine learning model is applied to train an optimal classifier for predicting the IHEI on the dataset. The experimental results show that this classifier can effectively predict the IHEI that can be applied into real human–robot interaction scenarios. Moreover, the proposed model is an interpretable machine learning model, where interpretability analysis on the trained classifier has been done to explore the deep associations between input features and engagement intention, thereby providing robust and effective robot social decision-making.