Voice Responsive Virtual Reality

Adinda van 't Klooster, and Nick Collins

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Our audio-reactive Virtual Reality (VR) interface encourages a performer to explore extended vocal techniques within an alternative visual aesthetic experience. We are interested in whether this can support creative vocal expression, and whether the sound-responsive animated hand-drawn aesthetics in the VR scene can help immersion and wellbeing. As an interface for musical expression, there is no extraneous sound output, but rather, an attempt to encourage investigation of a user’s own voice through a visual feedback system. We describe the technicalities of building the system as an Oculus Quest app, and evaluation through various existing theories pertinent to VR musical interaction.

Citation:

Adinda van 't Klooster, and Nick Collins. 2024. Voice Responsive Virtual Reality. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.13904876

BibTeX Entry:

  @article{nime2024_51,
 abstract = {Our audio-reactive Virtual Reality (VR) interface encourages a performer to explore extended vocal techniques within an alternative visual aesthetic experience. We are interested in whether this can support creative vocal expression, and whether the sound-responsive animated hand-drawn aesthetics in the VR scene can help immersion and wellbeing. As an interface for musical expression, there is no extraneous sound output, but rather, an attempt to encourage investigation of a user’s own voice through a visual feedback system. We describe the technicalities of building the system as an Oculus Quest app, and evaluation through various existing theories pertinent to VR musical interaction.},
 address = {Utrecht, Netherlands},
 articleno = {51},
 author = {Adinda van 't Klooster and Nick Collins},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.13904876},
 editor = {S M Astrid Bin and Courtney N. Reed},
 issn = {2220-4806},
 month = {September},
 numpages = {5},
 pages = {346--350},
 presentation-video = {https://youtu.be/oLGdSgaLe3Q?si=1HBogOyqhvSZvC5d},
 title = {Voice Responsive Virtual Reality},
 track = {Papers},
 url = {http://nime.org/proceedings/2024/nime2024_51.pdf},
 year = {2024}
}