Generate expressive music from picture with a handmade multi-touch music table

Simon Lui

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

The multi-touch music table is a novel tabletop tangible interface for expressive musical performance. User touches the picture projected on the table glass surface to perform music. User can click, drag or use various multi-touch gestures with fingers to perform music expressively. The picture color, luminosity, size, finger gesture and pressure determine the music output. The table detects up to 10 finger touches with their touch pressure. We use a glass, a wood stand, a mini projector, a web camera and a computer to construct this music table. Hence this table is highly customizable. The table generates music via a re-interpretation of the artistic components of pictures. It is a cross modal inspiration of music from visual art on a tangible interface.

Citation:

Simon Lui. 2015. Generate expressive music from picture with a handmade multi-touch music table. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1179122

BibTeX Entry:

  @inproceedings{slui2015,
 abstract = {The multi-touch music table is a novel tabletop tangible interface for expressive musical performance. User touches the picture projected on the table glass surface to perform music. User can click, drag or use various multi-touch gestures with fingers to perform music expressively. The picture color, luminosity, size, finger gesture and pressure determine the music output. The table detects up to 10 finger touches with their touch pressure. We use a glass, a wood stand, a mini projector, a web camera and a computer to construct this music table. Hence this table is highly customizable. The table generates music via a re-interpretation of the artistic components of pictures. It is a cross modal inspiration of music from visual art on a tangible interface. },
 address = {Baton Rouge, Louisiana, USA},
 author = {Simon Lui},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1179122},
 editor = {Edgar Berdahl and Jesse Allison},
 issn = {2220-4806},
 month = {May},
 pages = {374--377},
 publisher = {Louisiana State University},
 title = {Generate expressive music from picture with a handmade multi-touch music table},
 url = {http://www.nime.org/proceedings/2015/nime2015_191.pdf},
 year = {2015}
}