6 ms·
I am not an ML expert so not sure of the details on how it works, but I believe Google’s DDSP work is similar to 1: https://magenta.tensorflow.org/ddsp https://
by tomduncalf 6y ago
I am not an ML expert so not sure of the details on how it works, but I believe Google’s DDSP work is similar to 1: https://magenta.tensorflow.org/ddsp https://magenta.tensorflow.org/ddsp
As I understand it, their system can take an audio input and “learn” how to control the parameters of a synth to reproduce that sound. I had the pleasure of seeing a demo of it from someone who worked on it and thought it was impressive!
Synths have existed for a while which can use “resynthesis” to take a sound and recreate it using additive synthesis (e.g. Hartmann Neuron, Alchemy), but I wouldn’t probably call this AI/ML.
- TheOtherHobbes 6y agoIt's AI/ML if you capture sounds at different levels/frequencies, run them all through FFTs, and then use AI/ML to model how the FFTs change with level/frequency. The Neuron used to work like this - but it's not a cheap way to synthesise sounds, and it never sounded all that awesome. This works in the DX7's parameter space and tries to find sweet spots within that space - which are hard to discover, even if you know what you're doing. I'm not convinced it's much more successful than a plain old constrained parameter randomiser. But it is much easier to use.