Modeling multimodal interaction for performance evaluation

Abstract

When designing multimodal systems, the designer faces the problem of the choice of modalities to optimize the system usability. Based on modeling at a high level of abstraction, we propose an evaluation of this choice during the design phase, using a multi-criteria principle. The evaluation focuses on several points of view simultaneously, weighted according to the environment and the nature of the task. It relies on measures estimating the adequacies between the elements involved in the interaction. These measures arise from a fine decomposition of the interaction modalities. © 2009 Springer Berlin Heidelberg.