COSMIC: A Conversational Interface for Human-AI Music Co-Creation

Yixiao Zhang, Gus Xia, Mark Levy, and Simon Dixon

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2021
• Location: Shanghai, China
• Article Number: 41
• DOI: 10.21428/92fbeb44.110a7a32 (Link to paper)
• PDF link
• Presentation Video

Abstract:

In this paper, we propose COSMIC, a COnverSational Interface for Human-AI MusIc Co-Creation. It is a chatbot with a two-fold design philosophy: to understand human creative intent and to help humans in their creation. The core Natural Language Processing (NLP) module is responsible for three functions: 1) understanding human needs in chat, 2) cross-modal interaction between natural language understanding and music generation models, and 3) mixing and coordinating multiple algorithms to complete the composition.1

Citation:

BibTeX Entry:

  @inproceedings{NIME21_41,
 abstract = {In this paper, we propose COSMIC, a COnverSational Interface for Human-AI MusIc Co-Creation. It is a chatbot with a two-fold design philosophy: to understand human creative intent and to help humans in their creation. The core Natural Language Processing (NLP) module is responsible for three functions: 1) understanding human needs in chat, 2) cross-modal interaction between natural language understanding and music generation models, and 3) mixing and coordinating multiple algorithms to complete the composition.1},
 address = {Shanghai, China},
 articleno = {41},
 author = {Zhang, Yixiao and Xia, Gus and Levy, Mark and Dixon, Simon},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.21428/92fbeb44.110a7a32},
 issn = {2220-4806},
 month = {June},
 presentation-video = {https://youtu.be/o5YO0ni7sng},
 title = {COSMIC: A Conversational Interface for Human-AI Music Co-Creation},
 url = {https://nime.pubpub.org/pub/in6wsc9t},
 year = {2021}
}