Cross-Modal Terrains: Navigating Sonic Space through Haptic Feedback

Gabriella Isaac, Lauren Hayes, and Todd Ingalls

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2017
• Location: Copenhagen, Denmark
• Pages: 38–41
• DOI: 10.5281/zenodo.1176163 (Link to paper)
• PDF link

Abstract:

This paper explores the idea of using virtual textural terrains as a means of generating haptic profiles for force-feedback controllers. This approach breaks from the paradigm established within audio-haptic research over the last few decades where physical models within virtual environments are designed to transduce gesture into sonic output. We outline a method for generating multimodal terrains using basis functions, which are rendered into monochromatic visual representations for inspection. This visual terrain is traversed using a haptic controller, the NovInt Falcon, which in turn receives force information based on the grayscale value of its location in this virtual space. As the image is traversed by a performer the levels of resistance vary, and the image is realized as a physical terrain. We discuss the potential of this approach to afford engaging musical experiences for both the performer and the audience as iterated through numerous performances.

Citation:

BibTeX Entry:

  @inproceedings{gisaac2017,
 abstract = {This paper explores the idea of using virtual textural terrains as a means of generating haptic profiles for force-feedback controllers. This approach breaks from the paradigm established within audio-haptic research over the last few decades where physical models within virtual environments are designed to transduce gesture into sonic output.  We outline a method for generating multimodal terrains using basis functions, which are rendered into monochromatic visual representations for inspection. This visual terrain is traversed using a haptic controller, the NovInt Falcon, which in turn receives force information based on the grayscale value of its location in this virtual space. As the image is traversed by a performer the levels of resistance vary, and the image is realized as a physical terrain. We discuss the potential of this approach to afford engaging musical experiences for both the performer and the audience as iterated through numerous performances.},
 address = {Copenhagen, Denmark},
 author = {Gabriella Isaac and Lauren Hayes and Todd Ingalls},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176163},
 issn = {2220-4806},
 pages = {38--41},
 publisher = {Aalborg University Copenhagen},
 title = {Cross-Modal Terrains: Navigating Sonic Space through Haptic Feedback},
 url = {http://www.nime.org/proceedings/2017/nime2017_paper0008.pdf},
 year = {2017}
}