Exploring Design Patterns for Spatial Instruments: User-Driven Strategies, Spatialized Synthesis and Loudspeaker Topologies

Enrique Tomás, Florian Goeschke, and Martin Kaltenbrunner

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper investigates the field of spatialization tools and controllers within the context of immersive sound formats. After examining conventional approaches, we redefine spatialization tools as musical instruments challenging prevailing views of digital musical instruments confined to interface and synthesis components. Our exploration encompasses the projection, movement, and control of sound objects in diverse loudspeaker setups, emphasizing the reconnection of synthesis and space-related modulations. Addressing the multidimensional challenges associated with sound spatialization, we highlight some observed mapping strategies for the control of gestural and spatial information. In particular, we examine user-driven strategies, such as 'repurposed' controllers, 'interpreted' instruments, custom interfaces, and spatialized synthesis algorithms. Additionally, we introduce design patterns emphasizing an aesthetic standpoint, positioning music as space, advocating for the integration of loudspeaker topologies in the design process, and recoupling synthesis and spatialization. Illustrating our theoretical framework, we present three case studies of spatial digital musical instruments. These examples showcase the integration of spatialization with synthesis, offering a comprehensive approach to sound design. In conclusion, our exploration advocates for spatialization controller design strategies urging a transition to a more user-centric, adaptable, and holistic paradigm.

Citation:

Enrique Tomás, Florian Goeschke, and Martin Kaltenbrunner. 2024. Exploring Design Patterns for Spatial Instruments: User-Driven Strategies, Spatialized Synthesis and Loudspeaker Topologies. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.13904804

BibTeX Entry:

  @article{nime2024_19,
 abstract = {This paper investigates the field of spatialization tools and controllers within the context of immersive sound formats. After examining conventional approaches, we redefine spatialization tools as musical instruments challenging prevailing views of digital musical instruments confined to interface and synthesis components. Our exploration encompasses the projection, movement, and control of sound objects in diverse loudspeaker setups, emphasizing the reconnection of synthesis and space-related modulations. Addressing the multidimensional challenges associated with sound spatialization, we highlight some observed mapping strategies for the control of gestural and spatial information. In particular, we examine user-driven strategies, such as 'repurposed' controllers, 'interpreted' instruments, custom interfaces, and spatialized synthesis algorithms. Additionally, we introduce design patterns emphasizing an aesthetic standpoint, positioning music as space, advocating for the integration of loudspeaker topologies in the design process, and recoupling synthesis and spatialization. Illustrating our theoretical framework, we present three case studies of spatial digital musical instruments. These examples showcase the integration of spatialization with synthesis, offering a comprehensive approach to sound design. In conclusion, our exploration advocates for spatialization controller design strategies urging a transition to a more user-centric, adaptable, and holistic paradigm.},
 address = {Utrecht, Netherlands},
 articleno = {19},
 author = {Enrique Tomás and Florian Goeschke and Martin  Kaltenbrunner},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.13904804},
 editor = {S M Astrid Bin and Courtney N. Reed},
 issn = {2220-4806},
 month = {September},
 numpages = {6},
 pages = {127--132},
 presentation-video = {https://youtu.be/JaKZlAo_KpY?si=H_8mATaHHaWPIdGR},
 title = {Exploring Design Patterns for Spatial Instruments: User-Driven Strategies, Spatialized Synthesis and Loudspeaker Topologies},
 track = {Papers},
 url = {http://nime.org/proceedings/2024/nime2024_19.pdf},
 year = {2024}
}