Planet Adventures: An Augmented Reality Game using Facial Emotion Recognition

Abstract

Augmented reality is now on the forefront of technological advancements around the world with major consumer electronic companies like Apple, Microsoft, Ninatic, Lucyd, Augmented Reality Labs etc., investing in it to develop an AR interface for its users. In this work, authors proposed a game using various technologies in sync with augmented reality, visual scripting, and facial gestures without use of any complex devices. Facebook's SparkAR studio with integrated AI models are used in this proposed framework to recognise the face gestures based on DeepFace. The game works well along with all the individual systems like the collider system, point system and other parts in sync and a little bit of JavaScript code as well to display the points on the user's screen. The proposed AR game overcame the limitations of other AR games by using light weight and efficient technologies like visual scripting and 2D assets and eliminated the use of high-level hardware. A survey on user experience have been done using beta version and found good performance when compared to other similar AR games.