LiVo: Sing a Song with a Vowel Keyboard
Kazuhiko Yamamoto, and Takeo Igarashi
Proceedings of the International Conference on New Interfaces for Musical Expression
- Year: 2015
- Location: Baton Rouge, Louisiana, USA
- Pages: 205–208
- DOI: 10.5281/zenodo.1181414 (Link to paper)
- PDF link
- Supplementary File 1: 0120-file1.mp4
Abstract:
We propose a novel user interface that enables control of a singing voice synthesizer at a live improvisational performance. The user first registers the lyrics of a song with the system before performance, and the system builds a probabilistic model that models the possible jumps within the lyrics. During performance, the user simultaneously inputs the lyrics of a song with the left hand using a vowel keyboard and the melodies with the right hand using a standard musical keyboard. Our system searches for a portion of the registered lyrics whose vowel sequence matches the current user input using the probabilistic model, and sends the matched lyrics to the singing voice synthesizer. The vowel input keys are mapped onto a standard musical keyboard, enabling experienced keyboard players to learn the system from a standard musical score. We examine the feasibility of the system through a series of evaluations and user studies.
Citation:
Kazuhiko Yamamoto, and Takeo Igarashi. 2015. LiVo: Sing a Song with a Vowel Keyboard. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1181414BibTeX Entry:
@inproceedings{kyamamoto2015, abstract = {We propose a novel user interface that enables control of a singing voice synthesizer at a live improvisational performance. The user first registers the lyrics of a song with the system before performance, and the system builds a probabilistic model that models the possible jumps within the lyrics. During performance, the user simultaneously inputs the lyrics of a song with the left hand using a vowel keyboard and the melodies with the right hand using a standard musical keyboard. Our system searches for a portion of the registered lyrics whose vowel sequence matches the current user input using the probabilistic model, and sends the matched lyrics to the singing voice synthesizer. The vowel input keys are mapped onto a standard musical keyboard, enabling experienced keyboard players to learn the system from a standard musical score. We examine the feasibility of the system through a series of evaluations and user studies. }, address = {Baton Rouge, Louisiana, USA}, author = {Kazuhiko Yamamoto and Takeo Igarashi}, booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression}, doi = {10.5281/zenodo.1181414}, editor = {Edgar Berdahl and Jesse Allison}, issn = {2220-4806}, month = {May}, pages = {205--208}, publisher = {Louisiana State University}, title = {LiVo: Sing a Song with a Vowel Keyboard}, url = {http://www.nime.org/proceedings/2015/nime2015_120.pdf}, urlsuppl1 = {http://www.nime.org/proceedings/2015/120/0120-file1.mp4}, year = {2015} }