KIB: Simplifying Gestural Instrument Creation Using Widgets

Edward Zhang

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

The Microsoft Kinect is a popular and versatile input devicefor musical interfaces. However, using the Kinect for suchinterfaces requires not only signi_x000C_cant programming experience,but also the use of complex geometry or machinelearning techniques to translate joint positions into higherlevel gestures. We created the Kinect Instrument Builder(KIB) to address these di_x000E_culties by structuring gesturalinterfaces as combinations of gestural widgets. KIB allowsthe user to design an instrument by con_x000C_guring gesturalprimitives, each with a set of simple but attractive visualfeedback elements. After designing an instrument on KIB'sweb interface, users can play the instrument on KIB's performanceinterface, which displays visualizations and transmitsOSC messages to other applications for sound synthesisor further remapping.

Citation:

Edward Zhang. 2013. KIB: Simplifying Gestural Instrument Creation Using Widgets. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178698

BibTeX Entry:

  @inproceedings{Zhang2013,
 abstract = {The Microsoft Kinect is a popular and versatile input devicefor musical interfaces. However, using the Kinect for suchinterfaces requires not only signi_x000C_cant programming experience,but also the use of complex geometry or machinelearning techniques to translate joint positions into higherlevel gestures. We created the Kinect Instrument Builder(KIB) to address these di_x000E_culties by structuring gesturalinterfaces as combinations of gestural widgets. KIB allowsthe user to design an instrument by con_x000C_guring gesturalprimitives, each with a set of simple but attractive visualfeedback elements. After designing an instrument on KIB'sweb interface, users can play the instrument on KIB's performanceinterface, which displays visualizations and transmitsOSC messages to other applications for sound synthesisor further remapping.},
 address = {Daejeon, Republic of Korea},
 author = {Edward Zhang},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178698},
 issn = {2220-4806},
 keywords = {Kinect, gesture, widgets, OSC, mapping},
 month = {May},
 pages = {519--524},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {KIB: Simplifying Gestural Instrument Creation Using Widgets},
 url = {http://www.nime.org/proceedings/2013/nime2013_114.pdf},
 year = {2013}
}