4 ms·

As an amateur musician I’m wondering if there are any of these audio generators that you can give a tune or chord progression to riff on. ABC format maybe? Ther

As an amateur musician I’m wondering if there are any of these audio generators that you can give a tune or chord progression to riff on. ABC format maybe? There are lots of folk tunes on thesession.org. Could you generate a rhythm track? Ideally you could make songs one track at a time, by giving it a mix of the previous tracks and asking it to make another track for an instrument. Or, give it a track and ask it to do some kind of effect on it. Another interesting use might be generating sound samples for a sampled instrument.

emporas 3y ago
If you mean to give a source of melody of 30sec and extend that melody into a full song, yes MusicGen can do that. There are two ways to extend a song based on a melody: 1) give a sample, and continue the song from that sample as close as possible, and 2) give a melody as an inspiration. They both work in varying degrees of success. Audiocraft on github, issues or discussion sections have a lot of questions answered.
- chrisjj 3y ago
  Evidence? None of the demos suggest that is true.
  - emporas 3y ago
    Did they change the base model? If not, then the audiocraft_plus, is based on audiocraft, and it creates music of length close to 5 minutes. I don't know if audiocraft_plus incorporates all three modalities of the release, MusicGen, AudioGen, and EnCodec. It uses MusicGen for sure, all four models, small, medium, large and melody. https://github.com/GrandaddyShmax/audiocraft_plus https://github.com/GrandaddyShmax/audiocraft_plus
    - chrisjj 3y ago
      Bit is that "extension" to 5mkns more than just the repeat of e.g. 15secs heard in the demos?
      - emporas 3y ago
        Yes, of course it is more than that. You can create full songs of several minutes. I have published 20 songs on youtube of 2-3 minutes each. Listen to that song, the best i have made so far [1]. It doesn't repeat at all! I haven't looked closely to this release, is the audiocraft page on github different than facebookresearch/audiocraft? The other two modalities may be new, AudioGen, and EnCodec, but i was under the impression that they changed the license to full open source, and that was that. https://www.youtube.com/watch?v=UL1KmrHMjcM https://www.youtube.com/watch?v=UL1KmrHMjcM
        chrisjj 3y ago
        Thanks. What I hear there is 19s of material on repeat, with the parallel parts variously brought in and out, and no other variation except in decorative detail. So yes not a literal repeat, but no not enough to rate as a "full song", IMO. Plus it is not actually song at all, note. Singing would particularly expose its repeat-and-vary trick.

emporas 3y ago

If you mean to give a source of melody of 30sec and extend that melody into a full song, yes MusicGen can do that. There are two ways to extend a song based on a melody: 1) give a sample, and continue the song from that sample as close as possible, and 2) give a melody as an inspiration. They both work in varying degrees of success. Audiocraft on github, issues or discussion sections have a lot of questions answered.

chrisjj 3y ago
Evidence? None of the demos suggest that is true.
- emporas 3y ago
  Did they change the base model? If not, then the audiocraft_plus, is based on audiocraft, and it creates music of length close to 5 minutes. I don't know if audiocraft_plus incorporates all three modalities of the release, MusicGen, AudioGen, and EnCodec. It uses MusicGen for sure, all four models, small, medium, large and melody. https://github.com/GrandaddyShmax/audiocraft_plus https://github.com/GrandaddyShmax/audiocraft_plus
  - chrisjj 3y ago
    Bit is that "extension" to 5mkns more than just the repeat of e.g. 15secs heard in the demos?
    - emporas 3y ago
      Yes, of course it is more than that. You can create full songs of several minutes. I have published 20 songs on youtube of 2-3 minutes each. Listen to that song, the best i have made so far [1]. It doesn't repeat at all! I haven't looked closely to this release, is the audiocraft page on github different than facebookresearch/audiocraft? The other two modalities may be new, AudioGen, and EnCodec, but i was under the impression that they changed the license to full open source, and that was that. https://www.youtube.com/watch?v=UL1KmrHMjcM https://www.youtube.com/watch?v=UL1KmrHMjcM
      - chrisjj 3y ago
        Thanks. What I hear there is 19s of material on repeat, with the parallel parts variously brought in and out, and no other variation except in decorative detail. So yes not a literal repeat, but no not enough to rate as a "full song", IMO. Plus it is not actually song at all, note. Singing would particularly expose its repeat-and-vary trick.