Exploring workout repetition counting and validation through deep learning

Abstract

Studying human motion from images and videos has turned into an interesting topic of research given the recent advances in computer vision and deep learning algorithms. When focusing on the automatic procedure of tracking physical exercises, cameras can be used for full human pose estimation in relation to worn sensors. In this work, we propose a method for workout repetition counting and validation based on a set of skeleton-based and deep semantic features that are obtained from a 2D human pose estimation network. Given that some of the individuals’ body parts might be occluded throughout physical exercises, we also perform a multi-view analysis on supporting cameras to improve our recognition rates. Nevertheless, the obtained results for a single-view approach show that we are able to count valid repetitions with over 90% precision scores for 4 out of 5 considered exercises, while recognizing more than 50% of the invalid ones.