Integration of assistive technologies into 3D simulations: An exploratory study

Abstract

Currently, there are limited, commercially available video games for people with disabilities. Sim-Assist is a software system that aims to allow people with disabilities to interface with a three-dimensional simulation game of Air Hockey. This is accomplished through various integrated assistive technologies, such as brain-computer interfacing, voice commands, and speech-to-text capabilities. With Sim-Assist, users are able to play Air Hockey without depending on sight, and in a hands-free manner. We conducted an exploratory study to provide the foundation for integrating assistive technologies in 3D simulations, including scientific simulations and serious games. In this paper, we introduce the research and development of assistive technologies, focusing more on the BCI software component; outline our system design and implementation; provide a short walkthrough of the interface; and briefly discuss our preliminary results.