By Julian Moreira, Pierre Roy, and François Pachet.
In the Proceedings of the 14th International Society for Music Information Retrieval Conference (ISMIR 2013), pp. 341–346, Curitiba, Brazil.
Read the paper (PDF)
ISMIR proceedings PDF
About the paper
VirtualBand lets live musicians improvise with virtual players whose styles are derived from recordings. In a performance, the system listens to what the musicians play and uses features such as loudness and note density to choose recorded material that fits the interaction.
Abstract summary
The authors describe a multi-agent system in which a human or virtual player can influence another agent. Connections map musical features to conditions for selecting audio excerpts from a style database. The virtual players can respond in real time while drawing on the playing style of the musicians who supplied the recordings.
Related work
The Virtual Band project page describes the system and collects the performance examples.
Capturing a Musician’s Groove: Generation of Realistic Accompaniments from Single Song Recordings extends the use of recorded excerpts to generating accompaniments that preserve a player’s groove.