3 ms·
So is there an analagous process that would apply to audio I wonder?
by XorNot 9y ago
So is there an analagous process that would apply to audio I wonder?
- jerrre 9y agoWhat would the lo-res starting point be? Low sample-rate, bit depth, ...?
- magnat 9y agoThere kind of already is audio equivalent: MIDI. It supplies low resolution timing and pitch information and it's up to synthesizer to produce audio output matching those data.
- jeeceebees 9y agoI think the interesting part would be example based audio synthesis. Could you replace a synthesizer with a neural network which, when fed examples, would allow you to generate sounds / explore some latent space between the examples. For example an approach similar to https://gauthamzz.github.io/2017/09/23/AudioStyleTransfer/ https://gauthamzz.github.io/2017/09/23/AudioStyleTransfer/ but then using the methods described in the PixelNN paper.
- radarsat1 9y agoI'll just plug my recent work on my sound synthesis "copier": http://gitlab.com/sinclairs/sounderfeit http://gitlab.com/sinclairs/sounderfeit It more or less attempts to be what you describe. Not very polished yet, but I had some basic success in modeling the parameter space of a synth, and adding new latent spaces with regularization.
- dahart 9y agoYes, this is a fairly similar concept: https://magenta.tensorflow.org/nsynth https://magenta.tensorflow.org/nsynth This is actually training a neural network on the Markov model, so it's very similar to core ideas behind the OP's paper. The core idea is to model the probability of a bit of sound by breaking it into the last note and everything that comes before the last note ("P(audio)=P(audio∣note)P(note)"). If you sample a bunch of audio and factor it that way for any given point in time, and accumulate that data somewhere, you can then sample the accumulated data randomly to generate new music. There are other audio NN synthesis methods as well, pretty sure I've even seen one posted to ShowHN before.