Kinectofon: Performing with Shapes in Planes

Jensenius, Alexander Refsum

Proceedings of the International Conference on New Interfaces for Musical Expression

The paper presents the Kinectofon, an instrument for creating sounds through free-hand interaction in a 3D space. The instrument is based on the RGB anddepth image streams retrieved from a Microsoft Kinect sensor device. These twoimage streams are used to create different types of motiongrams, which, again, are used as the source material for a sonification process based on inverse FFT. The instrument is intuitive to play, allowing the performer to createsound by "touching" a virtual sound wall.