A Framework for Immersive Spatial Audio Performance

Wozniewski, Mike and Settel, Zack and Cooperstock, Jeremy R.

Proceedings of the International Conference on New Interfaces for Musical Expression

Traditional uses of virtual audio environments tend to focus onperceptually accurate acoustic representations. Though spatialization of sound sources is important, it is necessary to leveragecontrol of the sonic representation when considering musical applications. The proposed framework allows for the creation ofperceptually immersive scenes that function as musical instruments. Loudspeakers and microphones are modeled within thescene along with the listener/performer, creating a navigable 3Dsonic space where sound sources and sinks process audio according to user-defined spatial mappings.