Pharosphones: interactive audience participation using light

Zhengyang Ma, Iurii Kuzmin, Duan Ruilei, and Raul Masu

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper presents a novel approach to live performance that blends audience participation through the use of mobile phone lights tracking with music conduction. Drawing from the history of audience engagement in the arts and leveraging advancements in digital technology, we foster a dynamic and immersive interactive model that complements traditional musical conduction techniques. The performance was designed for a 270 degree concert hall which allows the audience to see each other. In this setting, by employing mobile phones not only as communication devices but as light emitters, we explore the symbiotic relationship among the various actors in a performance. To achieve that, we developed a computer vision system designed to translate the audience participation into shaping the sonic landscape of the performance. This process is underpinned by considerations of cybernetics and the feedback loop between human participants and technological systems, challenging conventional power structures within performance spaces. Through this work, we aim to expand the boundaries of interactive music creation, offering insights into the potential for technologically-facilitated audience entanglement and further the discussion with the context of music ecology.

Citation:

Zhengyang Ma, Iurii Kuzmin, Duan Ruilei, and Raul Masu. 2024. Pharosphones: interactive audience participation using light. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.13904923

BibTeX Entry:

  @article{nime2024_70,
 abstract = {This paper presents a novel approach to live performance that blends audience participation through the use of mobile phone lights tracking with music conduction. Drawing from the history of audience engagement in the arts and leveraging advancements in digital technology, we foster a dynamic and immersive interactive model that complements traditional musical conduction techniques. The performance was designed for a 270 degree concert hall which allows the audience to see each other. In this setting, by employing mobile phones not only as communication devices but as light emitters, we explore the symbiotic relationship among the various actors in a performance. To achieve that, we developed a computer vision system designed to translate the audience participation into shaping the sonic landscape of the performance. This process is underpinned by considerations of cybernetics and the feedback loop between human participants and technological systems, challenging conventional power structures within performance spaces. Through this work, we aim to expand the boundaries of interactive music creation, offering insights into the potential for technologically-facilitated audience entanglement and further the discussion with the context of music ecology. },
 address = {Utrecht, Netherlands},
 articleno = {70},
 author = {Zhengyang Ma and Iurii Kuzmin and Duan Ruilei and Raul Masu},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.13904923},
 editor = {S M Astrid Bin and Courtney N. Reed},
 issn = {2220-4806},
 month = {September},
 numpages = {6},
 pages = {480--485},
 presentation-video = {https://youtu.be/O9gEwMloRLk?si=wO9iCVnpj0DWAnaK},
 title = {Pharosphones: interactive audience participation using light},
 track = {Papers},
 url = {http://nime.org/proceedings/2024/nime2024_70.pdf},
 year = {2024}
}