3CMS: An interactive decision system for live performance

Abstract

A machine system is designed to analyze the musical aspects during the live performance, allowing an interactive and dynamic flow of new expressions and also opening new compositional forms and multimodal methods. The focus of this approach is to measure the expressiveness from distinct characters during the performance of the musical piece while decisions are made by the machine. This multimodal approach is implemented in the musical piece Três Microcanções de Câmara – Essência Pierrot, Atitude Arlequim, (In)Decisão Colombina (3CMS), where audio features and body motion are used by the algorithm to choose a particular musical ending.