Probabilistic Models for Designing Motion and Sound Relationships

Jules Françoise, Norbert Schnell, Riccardo Borghesi, and Frédéric Bevilacqua

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

We present a set of probabilistic models that support the design of movement and sound relationships in interactive sonic systems. We focus on a mapping--by--demonstration approach in which the relationships between motion and sound are defined by a machine learning model that learns from a set of user examples. We describe four probabilistic models with complementary characteristics in terms of multimodality and temporality. We illustrate the practical use of each of the four models with a prototype application for sound control built using our Max implementation.

Citation

Jules Françoise, Norbert Schnell, Riccardo Borghesi, and Frédéric Bevilacqua. 2014. Probabilistic Models for Designing Motion and Sound Relationships. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178764

BibTeX Entry

@inproceedings{jfrancoise12014,
 abstract = {We present a set of probabilistic models that support the design of movement and sound relationships in interactive sonic systems. We focus on a mapping--by--demonstration approach in which the relationships between motion and sound are defined by a machine learning model that learns from a set of user examples. We describe four probabilistic models with complementary characteristics in terms of multimodality and temporality. We illustrate the practical use of each of the four models with a prototype application for sound control built using our Max implementation.},
 address = {London, United Kingdom},
 author = {Jules Fran\c{c}oise and Norbert Schnell and Riccardo Borghesi and Fr\'ed\'eric Bevilacqua},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178764},
 issn = {2220-4806},
 month = {June},
 pages = {287--292},
 publisher = {Goldsmiths, University of London},
 title = {Probabilistic Models for Designing Motion and Sound Relationships},
 url = {http://www.nime.org/proceedings/2014/nime2014_482.pdf},
 year = {2014}
}