Crossmodal interaction: Using audio or tactile displays in mobile devices

Abstract

Mobile device users can be in a variety of different situations where visual, audio, or tactile feedback is not appropriate. This research aims to investigate the design of auditory/tactile crossmodal icons which can provide an alternative form of output using the most appropriate modality to communicate information. The results of this research will aid designers of mobile displays in creating effective crossmodal cues which require minimal training and provide alternative presentation modalities through which information may be presented if the context requires. © IFIP International Federation for Information Processing 2007.