The orchids software is the first complete system for abstract and temporal computer-assisted orchestration and timbral mixture optimization. It provides a set of algorithms and features to reconstruct any time-evolving target sound with a combination of acoustic instruments, given a set of psychoacoustic criteria. It can help composers to achieve unthinkable timbral colors by providing efficient sets of solutions that best match a sound target.
Timbre spaces have been used to study the relationships between different instrumental timbres,based on perceptual ratings. However, they provide limited interpretability, no generative capabilityand no generalization. Here, we show that variational auto-encoders (VAE) can alleviate these limitations, by regularizing their latent space during training in order to ensure that the latent space of audio follows the same topology as that of the perceptual timbre space. Hence, we bridge audio analysis, perception and synthesis into a single system.
The Projective Orchestration Dataset (POD) is a MIDI collection of 180 pairs of piano scores and corresponding orchestration performed by famous composers. Its purpose is to offer a framework for studying the relations between a piano score and its orchestral arrangements
The Orchestration Analysis and Research Database (Orchard) contains over 4000 annotations of orchestral effects within 65 full movements of orchestral pieces, spanning 1787-1943 (and one piece from 2004), and continues to grow
We recently developed the first live orchestral piano (LOP) system, a real-time automatic projective orchestration project. The system provides a way to compose music with a full classical orchestra in real-time by simply playing on a MIDI keyboard. Given piano score, the objective is to be able to automatically generate an orchestration.