Paralinguistic Microphone

McLean, Alex and Shin, EunJoo and Ng, Kia

Proceedings of the International Conference on New Interfaces for Musical Expression

The Human vocal tract is considered for its sonorous qualities incarrying prosodic information, which implicates vision in theperceptual processes of speech. These considerations are put in thecontext of previous work in NIME, forming background for theintroduction of two sound installations; “Microphone”, which uses acamera and computer vision to translate mouth shapes to sounds, and“Microphone II”, a work-in-progress, which adds physical modellingsynthesis as a sound source, and visualisation of mouth movements.