7 ms·
Open music foundation models for full-song generation
- lotyrin 1y agoVery nice. Anyone know of projects that aren't tackling the full-song problem but rather instrument parts/loops/stems/acapellas? I'd like something that's more like "infinite AI Loopcloud/Splice" most of these full-song models don't do well to be asked for individual parts in my experience (though I will have to try it with this one).
- platers 1y agohttps://suno.com/studio-waitlist https://suno.com/studio-waitlist Just a waitlist so far, but looks like this is the direction suno is going
- lotyrin 1y agoYeah... I hope this is what their plan is with that, but I'm not entirely certain.
- rwmj 1y agoAlso live AI dueting would be interesting, like having a virtual guitarist you could jam/duet with.
- lotyrin 1y agoYeah. Or like, a loop that plays continuously and has style parameters exposed you can tweak with a controller like a Midi Fighter Twister and get feedback from in real-time. Then you could do something akin to DJ/live production by having two of these going in sync with each other into a mixer. (Tweak params of the cue track until you like it, transition at a phrase point, repeat).
- HxokcPwi 1y agoLike this? https://aistudio.google.com/apps/bundled/promptdj?showPreview=true https://aistudio.google.com/apps/bundled/promptdj?showPrevie...
- lotyrin 1y agoOh! The idea that each parameter could be associated with a text style prompt is a refinement of the idea for sure.
- epiccoleman 1y agoYesssss. Something I'd really like is some kind of virtual drummer pedal with an expression pedal (pedals?) so that it can be tweaked in real time. One of the most fun things about jamming with other musicians is that things change with the ebb and flow of the band's energy. i always miss it when I'm just fooling around at home with a looper.
- HxokcPwi 1y agoJust saw this today: https://x.com/jesseengel/status/1953496623696556478 https://x.com/jesseengel/status/1953496623696556478
- HxokcPwi 1y agoTry https://magenta.withgoogle.com/infinite-crate https://magenta.withgoogle.com/infinite-crate
- vunderba 1y agoThis gets discussed a lot but unfortunately there's just not much out there around this. The closest thing I've seen is virtual drummers in Logic X which will follow along with the structure of your song and generate a percussive accompaniment. It's no substitute for a real drummer but it's serviceable.
- ErigmolCt 1y agoHonestly surprised no one's made a true "AI-Splice" yet
- dingnuts 1y ago[flagged]
- senko 1y agoIt does seem capable of stirring a lot of emotion, if your comment is any indication.
- bongodongobob 1y agoThe idea that all music is this super special blood sweat and tears spiritual thing is bullshit. Pop music is written to sell money and this doesn't prevent artists from doing their thing. Relax and let people like things.
- QuercusMax 1y agoThis is the fast food of music. It's soulless, and steals from real artists.
- bongodongobob 1y agoFast food doesn't steal from gourmet restaurants. If it's so bad, who cares?
- nartho 1y agoIt doesn't. But fast food and pre-cooked meals made it so a large percentage of people can't cook with raw or unprocessed ingredients anymore and can only rely on giant companies to feed themselves. Junk food is OK every once in a while, but if that's all you eat you're not going to be healthy. I believe the same is true for the media you consume. Edit: Also, to add to your analogy, junk food made it so people's palates became accustomed to high amounts of sugar, fat and salt, to a point where some people "Don't like water". If you've only known pizza rolls and chicken tenders, you're unlikely to enjoy a chicory salad or a even a moussaka. And if all your entertainment is call of duty, marvel movies and AI generated music, you're unlikely to enjoy Weather Report, Rachmaninoff or Pynchon. I'm not saying that to to be elitist, but we've got to stop dumbing down culture and entertainment
- ssalka 1y agoSomething interesting... the first 10 seconds or so of the "Death Growl" example[1] is basically copied verbatim from "Ov Fire And The Void" by Behemoth. More specifically, I think the part that seems copied is at 2:13 of the original[2], as it leads into a solo-ish bit which in the AI version sounds similar still, but goes on to do its own thing: [1] https://map-yue.github.io/music/moon.death_metal.mp3 https://map-yue.github.io/music/moon.death_metal.mp3 [2] https://youtu.be/vAmnsKKrt9w?t=133 https://youtu.be/vAmnsKKrt9w?t=133
- someothherguyy 1y ago> Additionally, our memorization-effect experiments in Section 11 demonstrate that our design maintains creativity without plagiarizing, even under strong training set conditioning. https://arxiv.org/html/2503.08638v1#S11 https://arxiv.org/html/2503.08638v1#S11
- amelius 1y agoDoes Shazam think it is the same?
- coldtea 1y agoDoes it matter? If the AI "comes up" with "Let it Be" melody on kazoo, it wont match "Let it Be" the Beatles single either, but it will still be plagiarized.
- vorgol 1y agoThe youtube link is suddenly not available any more (at least in the UK)
- hungmung 1y agoFunny because since the Blurred Lines lawsuit you can be infringing for using the same chord progression.
- alexjplant 1y agoThat decision was ridiculous. It's pretty obvious that the Robin Thicke song is a $1.50 Great Value version of "Got To Give It Up" because of the aesthetic similarities but they have nothing to do with each other melodically or harmonically... "Blurred Lines" sounds like I V with a walk at the end whereas "Got To Give It Up" is more like a I IV V. The vocal melodies aren't the same nor is the bass. They have different arrangements. The percussion isn't the same. The only things they have in common are vibes (in the contemporary sense, not vibraphones). Two dudes singing about sex in falsetto at 120bpm over prototypical R&B/funk elements isn't special. If that's the bar for copyright infringement then 99% of the popular music canon is illegally-derivative. Marvin Gaye was a singular talent but that doesn't mean that his heirs should be able to collect money every time somebody plays an electric piano bassline and sings about making whoopie in alto II.
- bangaladore 1y agoWhat is the use case for music generation models? I see usecases for alot of the other foundation models like text, image, tts, sst, but why do I want AI generated music?
- FridgeSeal 1y agoNow you don’t need to know how to make music! You’re finally free of all those pesky, elitist musicians gate-keeping music!!!!1!
- thrown-0825 1y ago[flagged]
- coldtea 1y agoAnd yet your comment is 100% reddit level, from a throw-away account nonetheless.
- frank_nitti 1y agoI’ve mostly used them for laughs with my friends. Sometimes generating “custom” songs with funny lyrics, but most fun so far is editing lyrics of existing songs to say ridiculous things for fun. No real clue how someone would use them for a more serious endeavor, only thing I could imagine would be to quickly iterate/prototype with song structures on a fixed seed to generate ideas for a real composition. Consider the case of an indie game developer or film maker getting some placeholder music to test the experience during early throwaway iterations.
- libraryatnight 1y agoGenerating crappy background music for reality TV?
- bangaladore 1y agoYeah, this seems the most likely. Just loads of royalty free background music for industries that want that.
- scarecrowbob 1y agoyeah, but have yall made any progress in a model that can have sex with my partner for me?
- NewsaHackO 1y agoI'd imagine that would not get much traction, as there are probably people that would pay you to do that. Since people pay to listen to music, and not to make it, AI has much more utility there. The great thing is, if you are someone who gets joy in making music, AI in no way limits this.
- coldtea 1y ago>The great thing is, if you are someone who gets joy in making music, AI in no way limits this. Sure it does. It commodifies your passion.
- NewsaHackO 1y agoWhat does commodifies your passion even mean?
- coldtea 1y agoIt means it takes the thing you're passionate about and makes a plasticky imitation of it available to be churned by the ton on demand You can still play to amuse yourself (if you're asocial enough), but now you're playing in a world that has your passion, skills, and sweat devalued and cheapened: comodified.
- NewsaHackO 1y agoI don't completely follow your logic here. Music has not been the only hobby that would fit under your definition of commodification of passion. Of the top of my head, woodworking, blacksmithing, glass blowing etc all fit this, yet there are thriving communities that still are able to enjoy doing it. Why would music be different? The only people I would expect to push back on this is people why are attempting to sell music, and not play for their own pleasure.
- kusokurae 1y agoNot using streaming services help somewhat, but I'm not looking forward to having to vet artists I come across for whether they did any substantial original thinking or work for themselves. Tired of snake oil foolishness.
- ErigmolCt 1y agoBetween AI-generated content and people chasing trends or algorithms, it can feel like everyone's just remixing the same stuff endlessly
- nartho 1y agoSubscribing to magazines of genres I like, consulting reddit and forums and using youtube to get an idea, and then buying losless files is what i've been doing.
- thrown-0825 1y agodid a fun experiment around this in 2015 based in karpathy’s unreasonable effectiveness of RNN’s post. i kept plucking away at it until i got it to a point where it could generate sheet music and guitar tabs in the style of various artists. would be fun to revisit that project with fresh eyes.
- ZoomZoomZoom 1y agoI get the incentives for full-song generation models, but it looks like it's the only thing that pops up. Where are the audio models I can use with a positive effect while working on music? Style transfer for instruments, restoration (but not just trained on over-compressed mp3s, talking about bad recording conditions), audio-to-audio editing? You'd think those would be easier to achieve than something that tries to just replace me completely.
- thinkalone 1y agoYou might find what you're looking for in VST plugins for DAWs, rather than standalone AI products
- ZoomZoomZoom 1y agoThere's a few commercial offerings but they seriously lag behind. Some very desirable features are just not available as plugins (or I didn't find them), like enhancing the recording quality: this is only available as paid services aimed for podcasters so work on spoken voice only. Again, the problem is that most of the offerings are trying to leverage the neural network for some complete solution, in the way replacing the steps professionals are perfectly able (and need to decide on) to take themselves. I'm constantly looking for specialized solutions that do the job that's impossible to make manually. The best example is Demucs for stem-splitting: it does one job and leaves me to work on the rest.
- qotgalaxy 1y ago[dead]