Training Polyphonic Models: Balancing Harmonics and Adaptability

Today we’re joined by Jesse Engel, Staff Research Scientist at Google, working on the Magenta Project. 

In our conversation with Jesse, we explore the current landscape of creativity AI, and the role Magenta plays in helping express creativity through ML and deep learning. We dig deep into their Differentiable Digital Signal Processing (DDSP) library, which “lets you combine the interpretable structure of classical DSP elements (such as filters, oscillators, reverberation, etc.) with the expressivity of deep learning.”

Finally, Jesse walks us through some of the other projects that the Magenta team undertakes, including NLP and language modeling, and what he wants to see come out of the work that he and others are doing in creative AI research.

The complete show notes for this episode can be found at twimlai.com/go/452.