Metabow: Gesture Mapping in Immersive Sonic Environments

Davor Vincze, Roberto Alonso, and Peter Nelson

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This paper presents the MetaBow, an augmented violin bow designed to control digital sound processing through real-time motion tracking. We discuss the challenges of mapping Inertial Measurement Unit (IMU) data to audio parameters in immersive multi-speaker environments and propose hybrid strategies using both direct mapping and machine learning models. We reflect on design choices, trade-offs, and performer experience, drawing from technical development and performance contexts. Three condensed case studies illustrate the system’s versatility in spatial and interactive musical performance.

Citation

Davor Vincze, Roberto Alonso, and Peter Nelson. 2025. Metabow: Gesture Mapping in Immersive Sonic Environments. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.15698918 [PDF]

BibTeX Entry

@article{nime2025_62,
 abstract = {This paper presents the MetaBow, an augmented violin bow designed to control digital sound processing through real-time motion tracking. We discuss the challenges of mapping Inertial Measurement Unit (IMU) data to audio parameters in immersive multi-speaker environments and propose hybrid strategies using both direct mapping and machine learning models. We reflect on design choices, trade-offs, and performer experience, drawing from technical development and performance contexts. Three condensed case studies illustrate the system’s versatility in spatial and interactive musical performance.},
 address = {Canberra, Australia},
 articleno = {62},
 author = {Davor Vincze and Roberto Alonso and Peter Nelson},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.15698918},
 editor = {Doga Cavdir and Florent Berthaut},
 issn = {2220-4806},
 month = {June},
 numpages = {4},
 pages = {432--435},
 title = {Metabow: Gesture Mapping in Immersive Sonic Environments},
 track = {Paper},
 url = {http://nime.org/proceedings/2025/nime2025_62.pdf},
 year = {2025}
}