InterFACE: new faces for musical expression

Deepak Chandran, and Ge Wang

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

InterFACE is an interactive system for musical creation, mediated primarily through the user's facial expressions and movements. It aims to take advantage of the expressive capabilities of the human face to create music in a way that is both expressive and whimsical. This paper introduces the designs of three virtual instruments in the InterFACE system: namely, FACEdrum (a drum machine), GrannyFACE (a granular synthesis sampler), and FACEorgan (a laptop mouth organ using both face tracking and audio analysis). We present the design behind these instruments and consider what it means to be able to create music with one's face. Finally, we discuss the usability and aesthetic criteria for evaluating such a system, taking into account our initial design goals as well as the resulting experience for the performer and audience.

Citation:

Deepak Chandran, and Ge Wang. 2018. InterFACE: new faces for musical expression. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1302569

BibTeX Entry:

  @inproceedings{Chandran2018,
 abstract = {InterFACE is an interactive system for musical creation, mediated primarily through the user's facial expressions and movements. It aims to take advantage of the expressive capabilities of the human face to create music in a way that is both expressive and whimsical. This paper introduces the designs of three virtual instruments in the InterFACE system: namely, FACEdrum (a drum machine), GrannyFACE (a granular synthesis sampler), and FACEorgan (a laptop mouth organ using both face tracking and audio analysis). We present the design behind these instruments and consider what it means to be able to create music with one's face. Finally, we discuss the usability and aesthetic criteria for evaluating such a system, taking into account our initial design goals as well as the resulting experience for the performer and audience.},
 address = {Blacksburg, Virginia, USA},
 author = {Deepak Chandran and Ge Wang},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1302569},
 editor = {Luke Dahl, Douglas Bowman, Thomas Martin},
 isbn = {978-1-949373-99-8},
 issn = {2220-4806},
 month = {June},
 pages = {244--248},
 publisher = {Virginia Tech},
 title = {InterFACE: new faces for musical expression},
 url = {http://www.nime.org/proceedings/2018/nime2018_paper0053.pdf},
 year = {2018}
}