3 ms·
If you mean to give a source of melody of 30sec and extend that melody into a full song, yes MusicGen can do that. There are two ways to extend a song based on
by emporas 3y ago
If you mean to give a source of melody of 30sec and extend that melody into a full song, yes MusicGen can do that. There are two ways to extend a song based on a melody: 1) give a sample, and continue the song from that sample as close as possible, and 2) give a melody as an inspiration.
They both work in varying degrees of success. Audiocraft on github, issues or discussion sections have a lot of questions answered.
- chrisjj 3y agoEvidence? None of the demos suggest that is true.
- emporas 3y agoDid they change the base model? If not, then the audiocraft_plus, is based on audiocraft, and it creates music of length close to 5 minutes. I don't know if audiocraft_plus incorporates all three modalities of the release, MusicGen, AudioGen, and EnCodec. It uses MusicGen for sure, all four models, small, medium, large and melody. https://github.com/GrandaddyShmax/audiocraft_plus https://github.com/GrandaddyShmax/audiocraft_plus
- chrisjj 3y agoBit is that "extension" to 5mkns more than just the repeat of e.g. 15secs heard in the demos?
- emporas 3y agoYes, of course it is more than that. You can create full songs of several minutes. I have published 20 songs on youtube of 2-3 minutes each. Listen to that song, the best i have made so far [1]. It doesn't repeat at all! I haven't looked closely to this release, is the audiocraft page on github different than facebookresearch/audiocraft? The other two modalities may be new, AudioGen, and EnCodec, but i was under the impression that they changed the license to full open source, and that was that. https://www.youtube.com/watch?v=UL1KmrHMjcM https://www.youtube.com/watch?v=UL1KmrHMjcM
- chrisjj 3y agoThanks. What I hear there is 19s of material on repeat, with the parallel parts variously brought in and out, and no other variation except in decorative detail. So yes not a literal repeat, but no not enough to rate as a "full song", IMO. Plus it is not actually song at all, note. Singing would particularly expose its repeat-and-vary trick.