11 ms·
Stable Audio Open
- minimaxir 2y agoNote that this has the typical noncommercial "you have to pay for a membership to use commercially" Stability license.
- simonw 2y agoSigh: Stable Audio Open is an open source text-to-audio model [...] License: https://huggingface.co/stabilityai/stable-audio-open-1.0/blob/main/LICENSE https://huggingface.co/stabilityai/stable-audio-open-1.0/blo... STABILITY AI NON-COMMERCIAL RESEARCH COMMUNITY LICENSE AGREEMENT Stability are one of the worse offenders for abusing the term "open source" at the moment.
- asylteltine 2y ago[dead]
- littlestymaar 2y agoWhat a shame for something that could have been completely free from copyright issues given the training source… (And they're still no legal ground on such a license claim since training hardly qualify as creative process on their side)
- jononor 2y agoThe training data is licensed under various Creative Commons licenses. These are not in anyway "completely free of copyright issues". Most of them have specific conditions on their use.
- elpocko 2y agoEvery time I call out the absurd interpretation of "Open Source" in this space in general, I get showered with downvotes and hateful attacks. One time someone posted their "AI mashup" project on reddit, that egregiously violated the terms of not only one, but several GPL-licensed projects. Calling this out earned me a lot of downvotes and replies with absolutely insane justifications from people with no clue. No one cares. Not in this space.
- jeroenhd 2y agoAI fans don't seem to care much for copyright, unless it's their work being stolen (remember the people that got mad at "prompt stealing"?). Companies are more risk-averse, though, and hobbyists on Reddit don't have the money to do anything serious with this software.
- elpocko 2y agoNope. Most of the relevant software is OSS made by hobbyists. ComfyUI, llama.cpp, etc. For example, Nvidia is building stuff based on ComfyUI, a GPL-licensed application. My complaint is about people ignoring the license of open source software made by hobbyists. I disagree with your ignorant "AI fans" generalization.
- immibis 2y agoto be fair, open-source is far too corporate-friendly at the moment. it should be more non-commercial. To what extent, is an open question.
- jeroenhd 2y agoOpen Source, as used by the most influential open source projects, is corporate-friendly by definition. There are good reasons to use something more aggressive. I'm a big fan of the strict copyleft licenses for this, even if that means companies like Google don't want to that software anymore.
- Zuiii 2y agoUnless you've explicitly agreed to this, or operate in a litigation-happy country and don't have a budget for lawyers and the small risk of loosing, feel free to ignore this license and others like it. Weights are not currently copyrightable. We have a photo of a smiling monkey to prove it.
- deleted 2y ago[deleted]
- hehdhdjehehegwv 2y agoHighly commendable: “The new model was trained on audio data from FreeSound and the Free Music Archive. This allowed us to create an open audio model while respecting creator rights.” This should be standard: commons go in, commons go out.
- mastermedo 2y agoExcept here the out is not commons if I understand correctly. EDIT: might be cc, non commercial
- samfriedman 2y agoFree idea because I’m never going to get around to building it: An “AI 8 track” app; click record and hum a melody, then add a prompt and click generate. The model converts your input to an instrument matching your prompt, keeping the same notes/rhythm you hummed in the original. Record up to 8 tracks and do some simple mixing. Would be a truly amazing thing for sketching songs! All you need is decent humming/singing/whistling pitch. Hum and generate a bass line, guitar lead, strings, etc. And then sing over it - would make solo musicians able to sketch out a song far easier than transcribing melody to a piano roll.
- michaelbrave 2y agothe tech is technically there using 2-5 different AI solutions, it mostly lacks an interface that automatically takes one step to the next
- xnx 2y agoGoogle MusicLM (and probably lots of other tools) do this: "MusicLM .. can transform whistled and hummed melodies according to the style described in a text caption." https://google-research.github.io/seanet/musiclm/examples/ https://google-research.github.io/seanet/musiclm/examples/
- samspenc 2y agoSounds like Suno AI will soon have this feature as well https://x.com/suno_ai_/status/1794408506407428215 https://x.com/suno_ai_/status/1794408506407428215
- ortusdux 2y agoApp name - Beat-it https://www.youtube.com/watch?v=eZeYw1bm53Y https://www.youtube.com/watch?v=eZeYw1bm53Y https://www.nme.com/blogs/nme-blogs/the-incredible-way-michael-jackson-wrote-music-16799 https://www.nme.com/blogs/nme-blogs/the-incredible-way-micha...
- eman2d 2y agoA killer Ad would be converting each vocal track back into the original song
- bufferoverflow 2y agoIt produces decent audio, but something unpleasant about its high frequencies. And no voices, it doesn't seem to talk or sing. Udio, so far, is undefeated. And ElevenLabs' music demos were very very impressive, but it's still not released.
- wavemode 2y agoAs far as I understand, this isn't competing with Udio? It seems to be designed for creating sound effects and loops, not entire songs.
- genericacct 2y agoHave you tried suno? It is quite good at least for some genres
- bufferoverflow 2y agoSuno is good at generating music, but its voices sound metallic with a dash of high-frequency noise. Which ruins it for me. It's almost there though, I think they will fix it in the next version.
- jononor 2y agoI suspect we will get ML based "upsamplers" / enchancers / artifact removers, similar as we already have for images. That can be used to automatically post process. If they do not already exist?
- bufferoverflow 2y agoI think the models will just get better. I mean, these already sound like professional recordings: https://twitter.com/elevenlabsio/status/1788628175766859891 https://twitter.com/elevenlabsio/status/1788628175766859891 https://twitter.com/flavioschneide/status/1788654503790628935 https://twitter.com/flavioschneide/status/178865450379062893... https://twitter.com/elevenlabsio/status/1788628178786787822 https://twitter.com/elevenlabsio/status/1788628178786787822 https://twitter.com/elevenlabsio/status/1788628173367685281 https://twitter.com/elevenlabsio/status/1788628173367685281 https://twitter.com/elevenlabsio/status/1788628171044053386 https://twitter.com/elevenlabsio/status/1788628171044053386 https://twitter.com/flavioschneide/status/1788678661215781347 https://twitter.com/flavioschneide/status/178867866121578134...
- Uehreka 2y ago> The new model was trained on audio data from FreeSound and the Free Music Archive. This allowed us to create an open audio model while respecting creator rights. This feels like the “Ethereum merge moment” for AI art. Now that there exists a prominent example with the big ethical obstacle (Proof of Work in the case of Ethereum, nonconsensual data-gathering in the case of generative AI) removed, we can actually have interesting conversations about the ethics of these things. In the past I’ve pushed back on people who made the argument that “generative AI intrinsically requires theft from artists”, but the terrible quality of models trained on public domain data made it difficult to make that argument in earnest, even if I knew I was right in the abstract.
- nickthegreek 2y agoI keep hearing about the pending death of Stability, but here we are with another release. I am rootin for them.
- treesciencebot 2y agoThis looks like the one that got leaked a couple weeks ago, so i guess they decided its better to open source at this point after the leak [0]. [0]: https://x.com/cto_junior/status/1794632281593893326 https://x.com/cto_junior/status/1794632281593893326
- tmabraham 2y agoit was already planned for open-sourcing, the leak did not affect the plans in any way
- washadjeffmad 2y agoIt is. The model.ckpt from petra-hi-small matches the official HF repo. SHA256: 6049ae92ec8362804cb4cb8a2845be93071439da2daff9997c285f8119d7ea40
- mg 2y agoWhen they released Stable Audio 2.0, I tried to create "unusual" songs with prompts like "roaring dragon tumbling rocks stormy morning". The results are quite interesting: https://www.youtube.com/@MarekGibney/videos https://www.youtube.com/@MarekGibney/videos I find it fascinating that you can put all information needed to recreate a whole complex song into a string like rough stormy morning car rocks hammering drum solo roaring dragon downtempo audiosparx-v2-0 seed 5 This means a whole album of these songs could easily fit into a single TCP/IP packet. If a music genre evolves in which each song is completely defined by its title, maybe it will be called "promptmusic". I will try the new model with the same prompts and upload the results.
- TeMPOraL 2y agoThat's a great example of the fact that information about something, say a song, isn't entirely encoded only in the medium you use to transfer it - it's partially there, and partially in the device you're using to read it! An MP3 file is just gibberish without a program that can decode it. In this case, the whole album could indeed fit into a single TCP/IP packet - because the bulk of information that make up those songs is contained in the model, which weights however many gigabytes it does. The packet carrying your album is meaningless until the recipient also procures the model. (Tangent: this observation was my first mind. blown. experience when reading GEB over a decade ago.)
- jononor 2y agoAlso note that it is the same for language. The meaning of these words are not in this text. The words are merely codes which point to things in the readers databank. And hopefully the word have similar enough associations to mine, such that the decoded message is close to what I attempted to encode...
- drivebyhooting 2y agoFrom announcement I couldn’t figure out if it can do audio to audio. Text to audio is too limiting. I’d rather input a melody or a drum beat and have the AI compose around it.
- duranduran 2y agoThis kind of exists, but I doubt there are any commercial solutions based on it yet. https://crfm.stanford.edu/2023/06/16/anticipatory-music-transformer.html https://crfm.stanford.edu/2023/06/16/anticipatory-music-tran... Their paper says that they trained it on the Lakh MIDI dataset, and they have a section on potential copyright issues as a result. Assuming you don't care for legal issues, theoretically you could do: raw signal -> something like Spotify Basic Pitch (outputs MIDI) -> Anticipatory (outputs composition) -> Logic Pro/Ableton/etc + Native Instruments plugin suite for full song
- ben_w 2y ago> Warm arpeggios on an analog synthesizer with a gradually rising filter cutoff and a reverb tail I appreciate that the underlying tech is completely different and much more powerful, but it is a pretty strange feeling to find a major AI lab's example sounding so similar to an actual Markov chain MIDI generator I made 14-15 years ago: https://youtu.be/depj8C21YHg?si=74a4DHP14EFCeYrB https://youtu.be/depj8C21YHg?si=74a4DHP14EFCeYrB (Not that similar, just enough for me to go "huh, what a coincidence").
- lancesells 2y ago"a drummer could fine-tune on samples of their own drum recordings to generate new beats" Yes, this is the reason someone becomes a drummer.
- 112233 2y agoCan this be refitted for noise reduction / audio restoration purposes? On hf they mention this is a "latent diffusion" model, I guess it implies there is a component inside that tries to recover noisy signal. [edit] If not, what free and open ML tools that can be used for restoration / deconvolution / denoising are there?
- sunlin 2y agothat's cool, there is a landing page i found it , can try it demo online. https://stable-audio-open.com/ https://stable-audio-open.com/