A Posture Training System Based on Therblig Analysis and YOLO Model—Taking Erhu Bowing as an Example

Abstract

Computer-assisted learning can help erhu learners to analyze their playing performance and identify areas for improvement. Therefore, in this study, a computerized system based on a You Only Look Once (YOLO)-OD model was developed for erhu bowing training. First, Therblig analysis was performed to segment the erhu bowing process into multiple steps, which were then analyzed thoroughly to identify critical objects for detection. Second, a YOLO-OD model was developed to detect and track the critical objects identified in video frames. Third, scoring methodologies were developed for bow level and bow straightness. The YOLO-OD model and the aforementioned scoring methodologies were incorporated into a computerized training system for erhu bowing, which enables erhu learners to practice independently. It provides scores for bow level and bow straightness, allowing learners to evaluate their technique, as well as feedback and instant alerts regarding incorrect motions and postures, which enable learners to adjust their actions and postures in real time. In addition, teachers or coaches can refer to the videos and other data collected using the proposed system in order to identify problematic erhu bowing techniques and provide students with relevant suggestions and feedback.