Cross-domain interactive composition in music

Abstract

This cross-domain interactive composition in music is based on the comprehension of a human’s mental ability of representing (schemata), associating, and cross domain mapping. While combining with the perception of improvisation, it is structured for creating interactive composition and animation. First, we select certain music pieces to represent musical motives (melodic or rhythmic patterns) associated with images as referents and the knowledge base. Secondly, through interacting with these associated auditory (music)-visual (images) motives on the game interface, the player improvises and creates an animation, the results of which will be a display of sounding images on screen as a complete animated music. Based on Piaget’s cognitive development and Kratus’ progressive mode of improvisation, it is designed for concrete operational children and will be tested in a public elementary schools.