Vokinesis: Syllabic Control Points for Performative Singing Synthesis

Samuel Delalez, and Christophe d'Alessandro

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Performative control of voice is the process of real-time speech synthesis or modification by the means of hands or feet gestures. Vokinesis, a system for real-time rhythm and pitch modification and control of singing is presented. Pitch and vocal effort are controlled by a stylus on a graphic tablet. The concept of Syllabic Control Points (SCP) is introduced for timing and rhythm control. A chain of phonetic syllables have two types of temporal phases : the steady phases, which correspond to the vocalic nuclei, and the transient phases, which correspond to the attacks and/or codas. Thus, syllabic rhythm control methods need transient and steady phases control points, corresponding to the ancient concept of the arsis and thesis is prosodic theory. SCP allow for accurate control of articulation, using hand or feet. In the tap mode, SCP are triggered by pressing and releasing a control button. In the fader mode, continuous variation of the SCP sequencing rate is controlled with expression pedals. Vokinesis has been tested successfully in musical performances, using both syllabic rhythm control modes. This system opens new musical possibilities, and can be extended to other types of sounds beyond voice.

Citation:

Samuel Delalez, and Christophe d'Alessandro. 2017. Vokinesis: Syllabic Control Points for Performative Singing Synthesis. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176220

BibTeX Entry:

  @inproceedings{sdelalez2017,
 abstract = {Performative control of voice is the process of real-time speech synthesis or modification by the means of hands or feet gestures. Vokinesis, a system for real-time rhythm and pitch modification and control of singing is presented.  Pitch and vocal effort are controlled by a stylus on a graphic tablet. The concept of Syllabic Control Points (SCP) is introduced for timing and rhythm control.  A chain of phonetic syllables have two types of temporal phases : the steady phases, which correspond to the vocalic nuclei, and the transient phases, which correspond to the attacks and/or codas. Thus, syllabic rhythm control methods need transient and steady phases control points, corresponding to the ancient concept of the arsis and thesis is prosodic theory. SCP allow for accurate control of articulation, using hand or feet. In the tap mode, SCP are triggered by pressing and releasing a control button. In the fader mode, continuous variation of the SCP sequencing rate is controlled with expression pedals.  Vokinesis has been tested successfully in musical performances, using both syllabic rhythm control modes. This system opens new musical possibilities, and can be extended to other types of sounds beyond voice. },
 address = {Copenhagen, Denmark},
 author = {Samuel Delalez and Christophe d'Alessandro},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176220},
 issn = {2220-4806},
 pages = {198--203},
 publisher = {Aalborg University Copenhagen},
 title = {Vokinesis: Syllabic Control Points for Performative Singing Synthesis},
 url = {http://www.nime.org/proceedings/2017/nime2017_paper0037.pdf},
 year = {2017}
}