ESsense - An Electrostatic Sensor System for Simple, Contactless Motion Control in Games

Abstract

We showcase ESsense, a system of electrostatic (ES) sensors for alternative controllers, and its potential as a low-cost, easily-assembled motion detection system, to enable new interactions otherwise inaccessible to DIY controller makers. We characterize their most suitable interactions and demonstrate their ability to remap game inputs and recontextualise existing games with motion detection. The custom motion controllers provide button-based games with greater immersion than their original inputs, requiring motion that corresponds intuitively to the game's displayed actions and reactions. We also developed a game demo that showcases the potential of this technology to create new experiences. It gives the player the role of a music conductor, allowing them to control the tempo of a music track by swinging a baton in front of a conductor's stand. Given its ability to detect motion of any kind, we also discuss other possibilities for the system, such as in contexts beyond games.