An Online Balance Training Application using Pose Estimation and Augmented Reality

Abstract

The evolution of digitally connected devices and artificial intelligence has opened the door for novel health and fitness applications that can be used by individuals at a time and in an environment convenient to them. The purpose of our research was to develop a platform that requires no additional hardware to provide an online home balance training program. Balance exercises are often prescribed for healthy aging to keep the body active, improve balance and coordination, and prevent falls and injuries, as well as, for those doing rehabilitation after injuries or diseases such as stroke. We developed a simple web application (BaART: Balance Augmented Reality Trainer) that uses PoseNet to determine a user’s location and pose for balance exercises. Furthermore, we looked at how augmented reality, and specifically adding a virtual chair, might impact a user’s sense of balance. In a study of 20 participants with and without balance disorders, we found that the developed system was easy to use, however, we also found that the virtual object (i.e. chair) was not used by most people. Furthermore, those with balance issues felt they required a real chair for balance and some even felt that the virtual object was distracting from the exercise. In the future, we will explore other uses of augmented reality, such as feedback on exercise quality, gaming features, and a virtual avatar trainer.