Soundscapes/Artabilitation – Evolution of a Hybrid Human Performance Concept, Method & Apparatus Where Digital Interactive Media, The Arts, & Entertainment are Combined

Abstract

‘SoundScapes’ is a body of empirical research that for almost two decades has focused upon investigating noninvasive gesture control of multi-sensory stimuli and potential uses in therapy and the arts. In this context noninvasive gesture refers to motion in invisible activity zones of a system input device utilizing technology outside of human vision. Especially targeted are disabled people of all ages, and special focus has been on the profoundly impaired who especially have limited opportunities for creative self-articulation and playful interaction. The concept has been explored in various situations including: - live stage performances; interactive room installations for museums, workshops, and festivals; and in health-care sessions at hospitals, institutes and special schools. Multifaceted aspects continuously cross-inform in a systemic manner, and each situation where the motion-sensitive environment is applied is considered as a hybrid system. Whilst simplistic in concept, i.e. learning by playful and creative doings, inherent are complexities of optimizing the interactive system to user-experience and evaluation of same. This chapter presents the system in context to its conceived-for-target community; it also presents the parallel practice-led investigations in performance art. Reciprocal design and reflective cross-analysis of the activities has resulted such that performance informs design and strategies of intervention and evaluation with impaired users, and vice versa.