Musical Exploration of Volumetric Textures in Mixed and Virtual Reality

Florent Berthaut

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

The development of technologies for acquisition and display gives access to a large variety of volumetric (3D) textures, either synthetic or obtained through tomography. They constitute extremely rich data which is usually explored for informative purposes, in medical or engineering contexts. We believe that this exploration has a strong potential for musical expression. To that extent, we propose a design space for the musical exploration of volumetric textures. We describe the challenges for its implementation in Virtual and Mixed-Reality and we present a case study with an instrument called the Volume Sequencer which we analyse using your design space. Finally, we evaluate the impact on expressive exploration of two dimensions, namely the amount of visual feedback and the selection variability.

Citation:

Florent Berthaut. 2021. Musical Exploration of Volumetric Textures in Mixed and Virtual Reality. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.21428/92fbeb44.6607d04f

BibTeX Entry:

  @inproceedings{NIME21_20,
 abstract = {The development of technologies for acquisition and display gives access to a large variety of volumetric (3D) textures, either synthetic or obtained through tomography. They constitute extremely rich data which is usually explored for informative purposes, in medical or engineering contexts. We believe that this exploration has a strong potential for musical expression. To that extent, we propose a design space for the musical exploration of volumetric textures. We describe the challenges for its implementation in Virtual and Mixed-Reality and we present a case study with an instrument called the Volume Sequencer which we analyse using your design space. Finally, we evaluate the impact on expressive exploration of two dimensions, namely the amount of visual feedback and the selection variability.},
 address = {Shanghai, China},
 articleno = {20},
 author = {Berthaut, Florent},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.21428/92fbeb44.6607d04f},
 issn = {2220-4806},
 month = {June},
 presentation-video = {https://youtu.be/C9EiA3TSUag},
 title = {Musical Exploration of Volumetric Textures in Mixed and Virtual Reality},
 url = {https://nime.pubpub.org/pub/sqceyucq},
 year = {2021}
}