Interaction and ergonomics issues in the development of a mixed reality construction machinery simulator for safety training

Abstract

We present the work on a simulator of construction machinery developed to train workers in their safe use. The simulation setup consists of a real versatile cabin placed on a motion platform in order to provide a realistic interaction with the system and a stereoscopic augmented reality system for visualization. We present some insights into the mixed reality setup we used for complex construction machines and discuss the interaction and usability problems that have arisen during its development and testing. Visualization has been implemented as a chroma-key-based mixed reality system, which combines the 3D virtual environment, the real cabin interior, and some superimposed messages to the user. As a result of our experience, we describe the main problems encountered from a usability and ergonomics point of view. © Springer-Verlag Berlin Heidelberg 2007.