Adaptive multimodal HCI with uncertain data by collaborative fission and fusion

Abstract

Multimodal systems that adapt their interface to the surroundings and the user shall be able to handle uncertain data provided by ubiquitous sensors. This has to be realized for the complete communication cycle and therefore demands collaboration between the system's output and input processes. In this article we demonstrate how dedicated fission and fusion components that handle uncertainty can be connected via an additional interaction content management component. We present the overall architecture of the resulting adaptive system and discuss the status quo of our implementation. © Springer-Verlag Berlin Heidelberg 2013.