The Multimodal Music Stand

Bell, Bo and Kleban, Jim and Overholt, Dan and Putnam, Lance and Thompson, John and Morin-Kuchera, JoAnn

Proceedings of the International Conference on New Interfaces for Musical Expression

We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer’s continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio.