Recognition Of Multivariate Temporal Musical Gestures Using N-Dimensional Dynamic Time Warping

Nicholas Gillian, Benjamin Knapp, and Sile O'Modhrain

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This paper presents a novel algorithm that has been specifically designed for the recognition of multivariate temporal musical gestures. The algorithm is based on DynamicTime Warping and has been extended to classify any N dimensional signal, automatically compute a classificationthreshold to reject any data that is not a valid gesture andbe quickly trained with a low number of training examples.The algorithm is evaluated using a database of 10 temporalgestures performed by 10 participants achieving an averagecross-validation result of 99%.

Citation

Nicholas Gillian, Benjamin Knapp, and Sile O'Modhrain. 2011. Recognition Of Multivariate Temporal Musical Gestures Using N-Dimensional Dynamic Time Warping. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178029 [PDF]

BibTeX Entry


@inproceedings{nime2011_Gillian_a,
abstract = {This paper presents a novel algorithm that has been specifically designed for the recognition of multivariate temporal musical gestures. The algorithm is based on DynamicTime Warping and has been extended to classify any N dimensional signal, automatically compute a classificationthreshold to reject any data that is not a valid gesture andbe quickly trained with a low number of training examples.The algorithm is evaluated using a database of 10 temporalgestures performed by 10 participants achieving an averagecross-validation result of 99%.},
address = {Oslo, Norway},
author = {Gillian, Nicholas and Knapp, Benjamin and O'Modhrain, Sile},
booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
doi = {10.5281/zenodo.1178029},
issn = {2220-4806},
keywords = {Dynamic Time Warping, Gesture Recognition, Musician-Computer Interaction, Multivariate Temporal Gestures },
pages = {337--342},
presentation-video = {http://nime.org/proceedings/2011/nime2011_Gillian_a.mov},
title = {Recognition Of Multivariate Temporal Musical Gestures Using N-Dimensional Dynamic Time Warping},
url = {http://www.nime.org/proceedings/2011/nime2011_337.pdf},
year = {2011}
}