Towards Rhythmic Analysis of Human Motion Using Acceleration-Onset Times

Eric Lee, Urs Enke, Jan Borchers, and Leo de Jong

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

We present a system for rhythmic analysis of human motion inreal-time. Using a combination of both spectral (Fourier) andspatial analysis of onsets, we are able to extract repeating rhythmic patterns from data collected using accelerometers. These extracted rhythmic patterns show the relative magnitudes of accentuated movements and their spacing in time. Inspired by previouswork in automatic beat detection of audio recordings, we designedour algorithms to be robust to changes in timing using multipleanalysis techniques and methods for sensor fusion, filtering andclustering. We tested our system using a limited set of movements,as well as dance movements collected from a professional, bothwith promising results.

Citation:

Eric Lee, Urs Enke, Jan Borchers, and Leo de Jong. 2007. Towards Rhythmic Analysis of Human Motion Using Acceleration-Onset Times. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177159

BibTeX Entry:

@inproceedings{Lee2007,
 abstract = {We present a system for rhythmic analysis of human motion inreal-time. Using a combination of both spectral (Fourier) andspatial analysis of onsets, we are able to extract repeating rhythmic patterns from data collected using accelerometers. These extracted rhythmic patterns show the relative magnitudes of accentuated movements and their spacing in time. Inspired by previouswork in automatic beat detection of audio recordings, we designedour algorithms to be robust to changes in timing using multipleanalysis techniques and methods for sensor fusion, filtering andclustering. We tested our system using a limited set of movements,as well as dance movements collected from a professional, bothwith promising results.},
 address = {New York City, NY, United States},
 author = {Lee, Eric and Enke, Urs and Borchers, Jan and de Jong, Leo},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177159},
 issn = {2220-4806},
 keywords = {rhythm analysis, dance movement analysis, onset analysis },
 pages = {136--141},
 title = {Towards Rhythmic Analysis of Human Motion Using Acceleration-Onset Times},
 url = {http://www.nime.org/proceedings/2007/nime2007_136.pdf},
 year = {2007}
}