SoundCraft: Transducing StarCraft 2

Cerqueira, Mark and Salazar, Spencer and Wang, Ge

Proceedings of the International Conference on New Interfaces for Musical Expression

SoundCraft is a framework that enables real-time data gathering from aStarCraft 2 game to external software applications, allowing for musicalinterpretation of the game’s internal structure and strategies in novel ways.While players battle each other for victory within the game world, a customStarCraft 2 map collects and writes out data about players’ decision-making,performance, and current focus on the map. This data is parsed and transmittedover Open Sound Control (OSC) in real-time, becoming the source for thesoundscape that accompanies the player’s game. Using SoundCraft, we havecomposed a musical work for two em StarCraft 2 players, entitled GG Music. Thispaper details the technical and aesthetic development of SoundCraft, includingdata collection and sonic mapping. Please see the attached video file for a performance of GG Music using theSoundCraft framework.