Design and Evaluation of a Gesture Controlled Singing Voice Installation

Cornelius Pöpel, Jochen Feitsch, Marco Strobel, and Christian Geiger

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2014
• Location: London, United Kingdom
• Pages: 359–362
• DOI: 10.5281/zenodo.1178905 (Link to paper)
• PDF link

Abstract:

We present a system that allows users to experience singing without singing using gesture-based interaction techniques. We designed a set of body-related interaction and multi-modal feedback techniques and developed a singing voice synthesizer system that is controlled by the user's mouth shapes and arm gestures. Based on the adaption of a number of digital media-related techniques such as face and body tracking, 3D rendering, singing voice synthesis and physical computing, we developed a media installation that allows users to perform an aria without real singing and provide the look and feel from a 20th century performance of an opera singer. We evaluated this system preliminarily with users.

Citation:

BibTeX Entry:

  @inproceedings{cgeiger2014,
 abstract = {We present a system that allows users to experience singing without singing using gesture-based interaction techniques. We designed a set of body-related interaction and multi-modal feedback techniques and developed a singing voice synthesizer system that is controlled by the user's mouth shapes and arm gestures. Based on the adaption of a number of digital media-related techniques such as face and body tracking, 3D rendering, singing voice synthesis and physical computing, we developed a media installation that allows users to perform an aria without real singing and provide the look and feel from a 20th century performance of an opera singer. We evaluated this system preliminarily with users.},
 address = {London, United Kingdom},
 author = {Cornelius Pöpel and Jochen Feitsch and Marco Strobel and Christian Geiger},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178905},
 issn = {2220-4806},
 month = {June},
 pages = {359--362},
 publisher = {Goldsmiths, University of London},
 title = {Design and Evaluation of a Gesture Controlled Singing Voice Installation},
 url = {http://www.nime.org/proceedings/2014/nime2014_439.pdf},
 year = {2014}
}