Tangible Signals-Prototyping Interactive Physical Sound Displays

Abstract

This work-in-progress paper presents three tangible user interface prototypes that use sensor technology in combination with mechanical actuators to provide an interactive physical display of sound and music data for people with visual impairments. The prototypes can be used either separately or combined as input and output devices utilizing pin-based, string-based and wheel-based interaction elements. They were developed as part of the research project Tangible Signals. In the paper, each prototype will be presented separately, including discussion of concept, interaction modalities, hardware design and possible use cases.