Management of Tracking for Mixed and Augmented Reality Systems

Abstract

Position and orientation tracking is a major challenge for mixed/augmented reality applications, especially in heterogeneous and wide-area sensor setups. In this chapter, we describe trackman, a planning and analysis tool which supports the AR-engineer in setup and maintenance of the tracking infrastructure. A new graphical modeling approach based on spatial relationship graphs (SRGs) eases the specification of known as well as the deduction of new relationships between entities in the scene. Modeling is based on reusable patterns representing the underlying sensor drivers or algorithms. Recurring constellations in the scene can be condensed into reusable meta patterns. The process is further simplified by semi-automatic modeling techniques which automize trivial steps. Data flow networks can be generated automatically from the SRG and are guaranteed to be semantically correct. Furthermore, generic tools are described that allow for the calibration/registration of static spatial transformations as well as for the live surveillance of tracking, accuracy. In summary, this approach reduces tremendously the amount of expert knowledge needed for the administration of tracking setups.