Expressive Control of Music and Visual Media by Full-Body Movement

Castellano, Ginevra and Bresin, Roberto and Camurri, Antonio and Volpe, Gualtiero

Proceedings of the International Conference on New Interfaces for Musical Expression

In this paper we describe a system which allows users to use their full-body for controlling in real-time the generation of an expressive audio-visual feedback. The system extracts expressive motion features from the user’s full-body movements and gestures. The values of these motion features are mapped both onto acoustic parameters for the real-time expressive rendering of a piece of music, and onto real-time generated visual feedback projected on a screen in front of the user.