Multimodal interaction: Intuitive, robust, and preferred?

Abstract

We investigated if and under which conditions multimodal interfaces (touch, speech, motion control) fulfil the expectation of being superior to unimodal interfaces. The results show that the possibility of multimodal interaction with a handheld mobile device turned out to be more intuitive, more robust, and more preferred than the interaction with the individual modalities speech and motion control. However, it was not clearly superior to touch. © 2009 Springer Berlin Heidelberg.