Towards multimodal interaction in smart home environments: The home operating system

Abstract

Future homes as smart and interactive environments will include a large and constantly growing number of networked devices that communicate with each other to coordinate activities. In this case the main challenge for developers and designers will be to offer possibilities to simply control this growing network of independent devices for different purposes, embodying complex technology, as well as managing a large number of information flows. In this paper we describe an approach of how to control such environments through the multimodal user interface of a home operating system. © 2010 ACM.