SoniMime: Movement Sonification for Real-Time Timbre Shaping

Fox, Jesse and Carlile, Jennifer

Proceedings of the International Conference on New Interfaces for Musical Expression

This paper describes the design of SoniMime, a system forthe sonification of hand movement for real-time timbre shaping. We explore the application of the tristimulus timbremodel for the sonification of gestural data, working towardthe goals of musical expressivity and physical responsiveness. SoniMime uses two 3-D accelerometers connected toan Atmel microprocessor which outputs OSC control messages. Data filtering, parameter mapping, and sound synthesis take place in Pd running on a Linux computer.