A scheme for multimodal component recommendation

Abstract

Multimodal interaction has proved to be a promising way for developing more accessible applications, especially for those people with visual impairments, but it still presents many challenges like the use of touchscreen devices and dynamic resources embedded in web content. For HCI, multimodal interaction is characterized by human intervention using a combination of different sensory modalities as input and output channels. In this paper, it is presented a scheme for recommendation of multimodal components for developing accessible applications and it is discussed lessons learned fromits use in the development and evaluation of applications using that scheme. This scheme has already been used to guide the development of two software tools, both aimed at improving accessibility for visually impaired people through multimodal interaction. Results have shown evidence that this scheme is fit for purpose and has given some pointers for a framework for multimodal accessible software development.