Tongue ā€˜nā€™ Groove: An Ultrasound based Music Controller

Vogt, Florian and Mccaig, Graeme and Ali, Mir A. and Fels, Sidney S.

Proceedings of the International Conference on New Interfaces for Musical Expression

Here we propose a novel musical controller which acquires imaging data of the tongue with a two-dimensional medical ultrasound scanner. A computer vision algorithm extracts from the image a discrete tongue shape to control, in realtime, a musical synthesizer and musical effects. We evaluate the mapping space between tongue shape and controller parameters and its expressive characteristics.