Sound Selection by Gestures

Baptiste Caramiaux, Frédéric Bevilacqua, and Norbert Schnell

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper presents a prototypical tool for sound selection driven by users' gestures. Sound selection by gesturesis a particular case of "query by content" in multimedia databases. Gesture-to-Sound matching is based on computing the similarity between both gesture and sound parameters' temporal evolution. The tool presents three algorithms for matching gesture query to sound target. Thesystem leads to several applications in sound design, virtualinstrument design and interactive installation.

Citation:

Baptiste Caramiaux, Frédéric Bevilacqua, and Norbert Schnell. 2011. Sound Selection by Gestures. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177977

BibTeX Entry:

@inproceedings{Caramiaux2011,
 abstract = {This paper presents a prototypical tool for sound selection driven by users' gestures. Sound selection by gesturesis a particular case of "query by content" in multimedia databases. Gesture-to-Sound matching is based on computing the similarity between both gesture and sound parameters' temporal evolution. The tool presents three algorithms for matching gesture query to sound target. Thesystem leads to several applications in sound design, virtualinstrument design and interactive installation.},
 address = {Oslo, Norway},
 author = {Caramiaux, Baptiste and Bevilacqua, Fr\'{e}d\'{e}ric and Schnell, Norbert},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177977},
 issn = {2220-4806},
 keywords = {Query by Gesture, Time Series Analysis, Sonic Interaction },
 pages = {329--330},
 title = {Sound Selection by Gestures},
 url = {http://www.nime.org/proceedings/2011/nime2011_329.pdf},
 year = {2011}
}