Musical Interaction with Hand Posture and Orientation: A Toolbox of Gestural Control Mechanisms

Mitchell, Thomas and Madgwick, Sebastian and Heap, Imogen

Proceedings of the International Conference on New Interfaces for Musical Expression

This paper presents a toolbox of gestural control mechanisms which are available when the input sensing apparatus is a pair of data gloves fitted with orientation sensors. The toolbox was developed in advance of a live music performance in which the mapping from gestural input to audio output was to be developed rapidly in collaboration with the performer. The paper begins with an introduction to the associated literature before introducing a range of continuous, discrete and combined control mechanisms, enabling a flexible range of mappings to be explored and modified easily. An application of the toolbox within a live music performance is then described with an evaluation of the system with ideas for future developments.