4 ms·
Their current demos seem worse than riffusion results I get on average. Music gen is hard because music is inherently a composed of many many different instrume
by not-chatgpt 4y ago
Their current demos seem worse than riffusion results I get on average. Music gen is hard because music is inherently a composed of many many different instruments, each with unique sound and function. Simply training end-to-end will almost always end up badly.
- robitsT6 4y agoI'm sorry, I like riffusion as much as the next guy, but in what world is any riffusion example better than the literal first example on this demo page?
- not-chatgpt 4y agoMight be personal preference, but I don't think those examples are good at all. The only thing I am impressed with is the story mode and conditioning. I typically use riffusion to generate swing/electropop music, could be I'm too biased.
- zone411 4y ago> Music gen is hard because music is inherently a composed of many many different instruments, each with unique sound and function. Simply training end-to-end will almost always end up badly. Yes! That's what I figured when I started my project to create an AI assistant for melodies (http://melodies.ai/ http://melodies.ai/). I'm quite sure that splitting it up is the way to go, and that the first AI hit song will not be created as a full song but by combining instruments/vocals.
- andreyk 4y agoFYI, they don't actually train end-to-end, they have three separate models that are each trained via self-supervised learning independently (I think, I haven't read the paper very carefully).
- jsemrau 4y agoMakes one wonder if there are models that rely on loops.