Interpolating Audio and Haptic Control Spaces

Juliette Regimbal, and Marcelo M. Wanderley

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2021
• Location: Shanghai, China
• Article Number: 35
• DOI: 10.21428/92fbeb44.1084cb07 (Link to paper)
• PDF link
• Presentation Video

Abstract:

Audio and haptic sensations have previously been linked in the development of NIMEs and in other domains like human-computer interaction. Most efforts to work with these modalities together tend to either treat haptics as secondary to audio, or conversely, audio as secondary to haptics, and design sensations in each modality separately. In this paper, we investigate the possibility of designing audio and vibrotactile effects simultaneously by interpolating audio-haptic control spaces. An inverse radial basis function method is used to dynamically create a mapping from a two-dimensional space to a many-dimensional control space for multimodal effects based on user-specified control points. Two proofs of concept were developed focusing on modifying the same structure across modalities and parallel structures.

Citation:

BibTeX Entry:

  @inproceedings{NIME21_35,
 abstract = {Audio and haptic sensations have previously been linked in the development of NIMEs and in other domains like human-computer interaction. Most efforts to work with these modalities together tend to either treat haptics as secondary to audio, or conversely, audio as secondary to haptics, and design sensations in each modality separately. In this paper, we investigate the possibility of designing audio and vibrotactile effects simultaneously by interpolating audio-haptic control spaces. An inverse radial basis function method is used to dynamically create a mapping from a two-dimensional space to a many-dimensional control space for multimodal effects based on user-specified control points. Two proofs of concept were developed focusing on modifying the same structure across modalities and parallel structures.},
 address = {Shanghai, China},
 articleno = {35},
 author = {Regimbal, Juliette and Wanderley, Marcelo M.},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.21428/92fbeb44.1084cb07},
 issn = {2220-4806},
 month = {June},
 presentation-video = {https://youtu.be/eH3mn1Ad5BE},
 title = {Interpolating Audio and Haptic Control Spaces},
 url = {https://nime.pubpub.org/pub/zd2z1evu},
 year = {2021}
}