Fluid Simulation as Full Body Audio-Visual Instrument

Johnston, Andrew

Proceedings of the International Conference on New Interfaces for Musical Expression

This paper describes an audio-visual performance system based on real-timefluid simulation. The aim is to provide a rich environment for works whichblur the boundaries between dance and instrumental performance – and sound andvisuals – while maintaining transparency for audiences and new performers. The system uses infra-red motion tracking to allow performers to manipulate areal-time fluid simulation, which in turn provides control data forcomputer-generated audio and visuals. It also provides a control andconfiguration system which allows the behaviour of the interactive system to bechanged over time, enabling the structure within which interactions take placeto be ‘composed’.