Controlling Physically Based Virtual Musical Instruments Using The Gloves

Serafin, Stefania and Trento, Stefano and Grani, Francesco and Perner-Wilson, Hannah and Madgwick, Seb and Mitchell, Tom

Proceedings of the International Conference on New Interfaces for Musical Expression

In this paper we propose an empirical method to develop mapping strategies between a gestural based interface (the Gloves) and physically based sound synthesis models. An experiment was performed in order to investigate which kind of gestures listeners associate to synthesised sounds produced using physical models, corresponding to three categories of sound: sustained, iterative and impulsive. The results of the experiment show that listeners perform similar gestures when controlling sounds from the different categories. We used such gestures in order to create the mapping strategy between the Gloves and the physically based synthesis engine.