11 ms·
Turn ideas into music with MusicLM
- celtoid 3y agoMusician and composer here. This might make for some interesting sounds but it's not music in any human sense.
- ShamelessC 3y agoHuman here. I think you mean it’s not music in an academic sense. Or have you forgotten the subjective nature of this? I’m certainly not happy about it, but I mean - people liked Soulja Boy’s “Yah bitch yah” and Cee Lo Green’s “Transformer”. Surely they could find something like these tracks pleasant as well.
- InCityDreams 3y agoNot a Zappa fan, either?
- user- 3y agoNo where in the article does it mention that you have to use a google account and sign up for the waiting list for their A.I labs
- quaintdev 3y agoI honestly need an AI to flag clickbait articles
- MattGaiser 3y agoI got off the waitlist in about a half hour when I signed up.
- zb3 3y agoI signed up yesterday and I'm still on waitlist. Maybe I was too honest..
- luckydata 3y agois it really THAT important of a detail?
- jandrese 3y agoIs it supposed to be shocking that you need a Google account to use a Google service?
- ccozan 3y agoWell, search , for example. No account needed. The DNS maybe as well.
- WillPostForFood 3y agoYou need a google account, but not a google workspace account, to sign up for a waiting list to get access. That's pretty far from "Google makes its text-to-music AI public".
- chaps 3y agoYou also can't signup with a workspace account.
- ilikehurdles 3y agoAh that explains it. I love being punished by Google for being a paying customer of theirs. It happens so ridiculously often.
- deltree7 3y ago[dead]
- jefftk 3y agoYou can join the waitlist at https://aitestkitchen.withgoogle.com/experiments/music-lm https://aitestkitchen.withgoogle.com/experiments/music-lm
- belter 3y ago[flagged]
- ShamelessC 3y agoWait so they aren’t releasing weights? (╯°□°)╯︵ ┻━┻
- jefftk 3y agoJust got let in off the waitlist. Initial thoughts: * It really doesn't understand what makes good fiddle tunes. So bad. * It's somewhat better with electronic music, but while it's locally solid (each ~2sec bit is good) it's jerky when you listen for a longer period.
- Keyframe 3y agowaiting list.. bard not available in country.. promises, talks.. and I've been a paying customer of google on several of their fronts. Meanwhile I've been a paying customer of OpenAI for several months already. Google needs to replace CEO asap if they want to stay. It's evident how incompetent management there is.
- endisneigh 3y agoI’m happy that OpenAI has lit a fire under Google’s butt.
- nico 3y ago[flagged]
- klabb3 3y agoCompetition is a critical driver of innovation and openness under capitalist incentives. Google had virtually no competition for a long time and they predictably stagnated. That’s why it’s so critical to curb monopolies–there’s no way to “speak with your wallet” if the only choices are say Comcast and Spectrum. It’s also way easier to regulate effectively and fairly than reform economic incentives in other ways. I’d prefer a free market economy with a vibrant distribution of small-medium entities over a highly regulated marketplace with only a few behemoths. Ironically, corporate behemoths operate in similar ways to bloated government bureaucracies on the complete opposite end of the political spectrum.
- pb7 3y agoWhile S&P500 trended downwards, Google’s stock price is up 9% since PaLM 2 first leaked this week so the market does not agree with your assessment of the tech.
- nico 3y agoYes, clearly However I would say they don’t agree with my assessment of the price Wall Street couldn’t care less about Google’s technology as long as google can make money of of it
- andreyk 3y agoFYI, this is MusicLM, which was just recently published and appears to be way ahead of anything out there so far. You can check out examples here https://google-research.github.io/seanet/musiclm/examples/ https://google-research.github.io/seanet/musiclm/examples/ So this is not just empty PR by Google.
- dang 3y ago(This comment was in response to https://techcrunch.com/2023/05/10/google-makes-its-text-to-music-ai-public/ https://techcrunch.com/2023/05/10/google-makes-its-text-to-m.... We merged https://news.ycombinator.com/item?id=35919370 https://news.ycombinator.com/item?id=35919370 into this thread.)
- pnw 3y agoMaybe it’s just me, but the further the prompts get from a concrete descriptions of instruments and compositions to abstract ideas and emotions, the more random and unpleasant the result.
- ilikehurdles 3y agoLooks promising, but I keep getting “could not fetch waitlist status” after signing in.
- canadianwriter 3y agoNon-clickbait link: https://aitestkitchen.withgoogle.com/experiments/music-lm https://aitestkitchen.withgoogle.com/experiments/music-lm Its part of AI test kitchen, if you were already part of that for playing with BARD and stuff you just need to log in and give it a go. If not, you'll have to get on the waitlist. When I asked I got access within a day, but might be much slower now with so much interest. Here are a bunch of examples of the music: https://google-research.github.io/seanet/musiclm/examples/ https://google-research.github.io/seanet/musiclm/examples/ In my opinion it isn't exactly great. It doesn't do much creativity. Eg. I asked it to make a dance song from a club but have classical instruments as well. It was unable to do that. It's mono and can often be out of tune. We will see how it improves, but this certainly isn't taking away jobs for musicians in it's current state.
- zwieback 3y agoThose examples are really hard to listen to, except for maybe the techno/dancebeat ones. Part of the problem is the awful sound, would be much more interesting to have scores generated by AI and then have musicians record it. As it is you can't really tell why it sounds so awful.
- nr2x 3y agoYes, I actually found that painful to listen to. Interesting to see where it goes, but for this erstwhile musician it’s like fingers in a chalk board.
- 55555 3y agoGive it 3 months. We've gone through this already with generative image AI. Another vibe I'm getting from reading these comments is that musicians clearly have discerning taste. Unfortunately, I don't think the public really does. I certainly don't. All these samples sound "good" to me.
- nr2x 3y agoYeah I’m sure it will get better, but I’d you have a musical ear this is pure torture.
- wilg 3y agoI’m still sad Google bought and killed Ditty, which was such a fun app for making little songs out of text.
- zone411 3y agoMaybe I'll be proven wrong but I believe this approach won't lead to unique, popular new songs. There isn't enough high quality training data. I think that for some time, the best approach will involve using AI as an assistant for different components of a song. That's what I've been doing with the melodies: https://www.melodies.ai/ https://www.melodies.ai/.
- d23 3y agoI like some of the outputs, but as far as I can tell you aren't exposing any way to actually use the model? And the last demos you posted are a year ago?
- neom 3y agoMake a song for the computer nerds at hackernews, the song should be geeky, with computer tones, modem sounds, very weird but also smooth: https://share.getcloudapp.com/7KuzO6QO https://share.getcloudapp.com/7KuzO6QO Let's make some tropical house, use the lyrics "call my private number" as the hook, the vibes should be disco, light, fun: https://share.getcloudapp.com/2Nub4m6B https://share.getcloudapp.com/2Nub4m6B Let's take some classical music and turn it into techno: https://share.getcloudapp.com/NQuW6lBP https://share.getcloudapp.com/NQuW6lBP tropical house, 120bpm, bongos, wind chime, flutes: https://share.getcloudapp.com/2Nub4mDq https://share.getcloudapp.com/2Nub4mDq Last one is pretty cool ^^
- rcarr 3y agoThe last tropical house one is better than the first one in that it gets the house 4/4 drums right whereas the first one sounds more like a rap track. It’s still got elevator music vibes though.
- dS0rrow 3y agoThanks for sharing! In the 1st example ["computer nerds", "hackernews", "geeky", "computer tones"] seem to make the result sound more like an old-school RPG soundtrack rather than a song.
- SeanAnderson 3y agoI dunno, I got Glitch Mob vibes from it. Not exactly Top 40, but still musical. Something like this? https://www.youtube.com/watch?v=DHGxEVHZXlU&t=40s https://www.youtube.com/watch?v=DHGxEVHZXlU&t=40s
- bardan 3y ago> more like an old-school RPG soundtrack rather than a song Well I'm just going to go ahead and pretend I didn't hear that.
- amelius 3y agoNice, but somehow it feels like I've heard these songs before. Could that be possible?
- waboremo 3y agoPlayed around with this a bit and was impressed. It's absolutely not ready to mix you a background playlist for evening dinner yet that doesn't leave your guests with a migraine, but ok for prototyping different feels of whatever music you are trying to create if that's a part of your process. I believe the (tech using) public has had enough exposure to AI generated voices in music that this experiment will likely seem disappointing.
- zyang 3y agoMaybe someone more knowledgable with music theory can chime in, but the generated tunes sounds off to me. Bit like a render in the uncanny valley. Something is wrong but I can't put my finger on it.
- kweingar 3y agoYeah, it’s basically stable diffusion but for music
- drummojg 3y agoI used "rollicking" in one description and it was exactly what it sounds like to your unconscious when you are far too drunk at a country bar
- famouswaffles 3y agoNot Stable Diffusion. MusicLM is a neural codec language model. Basically if GPT was predicting the next audio token while conditioned on text.
- ShamelessC 3y agoSo like DALLE-1? FWIW, the various diffusion models (tend to) use cross attention to an attention-based approach.
- peterkos 3y agoThese models aren't actually doing any musical comparison -- they are trained on audio, and from audio, piece apart with a "note" and a "melody" and an "instrument" are from the labelled training data. No intentional theory is being done! Algorithmic music composition has usually been split into two: 1. Generate notes (re: theory, genre) 2. Generate sound (i.e., EMI[0], Kulitta[1], MusicNet[2]) Now we are doing both at the same time, and backwards. The model isn't (necessarily) going "write melody, then generate the sound", but rather, "here are 500 songs that are described with X, 500 with Y, and you want XY, so we'll combine these two" :) (This is my best understanding, so feel free to correct) [0]: http://artsites.ucsc.edu/faculty/cope/experiments.htm http://artsites.ucsc.edu/faculty/cope/experiments.htm [1]: https://hackage.haskell.org/package/Kulitta https://hackage.haskell.org/package/Kulitta [2]: https://zenodo.org/record/5120004 https://zenodo.org/record/5120004
- zoogeny 3y agoI'm sure that there is a good reason why, but I dislike that Google Workspace accounts are often excluded from these kinds of things. I mean, I pay Google every month real money and in exchange I get less? Add in the fact that I was denied access to the Bard trial due to it not being available in my country and I'm pretty uninterested in Google's releases in general these days. I had the same experience when the new Pixel Fold was released and instead of getting to see the product page I was redirected to the default Google store home page for my country. I couldn't even learn about the product.
- mark_l_watson 3y agoI hear you. Twice I have signed up for Google Workplace with my custom domain name and was very happy with the service, except having to deal with two Google accounts. I subscribe to several Google service using my free gmail account. EDIT: I like MusicLM, I was trying it earlier today.
- VWWHFSfQ 3y agoI'm pretty sure Google workplace accounts have a different privacy policy and ToS than regular accounts. It makes sense that they're separate if the service requires agreement to one ToS but not the other.
- sp332 3y agoWorkspace accounts get more support, right? So they only add products and features they're willing to do support for.
- blowski 3y agoThey could say “support is limited to the following services”.
- criley2 3y agoAll Google One subscribers get support on any Google product.
- shadowgovt 3y ago
- mellosouls 3y agoThis is not intended as negative because this looks cool but I noped out when reading the small print about data privacy for Test Kitchen generally. Perhaps I was over-cautious or unfair in this case (I'm all in on MS/OpenAI stuff) just a gentle suggestion to give it some consideration if you don't normally pay it much mind.
- stainablesteel 3y agoa pretty big missed opportunity for a distributed record label if i had this i would let people make music with it for free, put it under a de-facto license that allows google & the creator to distribute it, host it on a semi-social platform, and take a cut of the money that rolls in but that's crazy, its not like they already have a massive video platform to host music videos
- aimor 3y agoOn the waitlist, but curious to know if it can generate non-instrumental sound effects.
- aimor 3y agoOff the waitlist. It does not do sound effects.
- unix_fan 3y agoThe AI test kitchen app is not accessible with voiceover
- tonetheman 3y agoI am a musician and this is interesting to me at least. Some of it is laughably bad but there is some goodness in it too. I could see this being used as a tool for song writers as it is currently it could be useful. Tell the AI a prompt listen to it and get some ideas. I do not think it is coherent enough to write a full song but I downloaded a few prompts and thought there is something good in this snippet. This is good work whoever did it.
- sfcarrot 3y agoI know this is about how to convert text-to-music. But, is it just me to find most of the sample "music" to be melody-less. The beats and flow make it sounds like "music" but it is truly not. I'd call it text-to-noise for now lol
- spaceman_2020 3y agoAnyone who has tried it - can you extract only specific instrument sounds from it instead of complete songs? Like just a kick drum sound?
- liminalsunset 3y agoYes, to an extent. I tried a bunch of things to get it to generate kick drums, but it seemed to always include some other drums like a snare or even the cymbals. Piano worked fine for me too. I haven't spent too long with it yet but I'm sure it can be done, even if not consistently.
- genghisjahn 3y agoMake a typical techno song. I got this… https://youtu.be/JwZwkk7q25I https://youtu.be/JwZwkk7q25I
- milchek 3y agoAs a metal lover and hack guitarist, I would love an AI bandmate drummer that jams along with me. Back when I used to play in bands, I’d often jam with a mate who was a drummer, he’d wait for me to start with a riff and then join in. Sure, I can record some riffs at home and add realistic drums myself in a DAW, or use a basic drum machine, but the magic was in the unique unpredictability of how he’d interpret my riff and the beats he’d come up with on the fly. As I got older, I stopped playing in bands, lost touch with this particular mate (who also stopped drumming) and generally don’t play guitar as much as I used to. Give me a generative AI bandmate that listens to me while I play for a second and joins in and you have my money.
- montag 3y agoMy hot take is that music is vastly underdetermined by text prompts, leaving too much control up to the model, so it's kind of doomed to produce Muzak.
- samstave 3y agomake a track like Ministry Industrial style in the form of "So What" but talking about GPU frameworks.
- IndySun 3y agoA sentence of several words delivers (or doesn't) music, and people can only criticise. Predictably, on the topic of music, an area now apparently equally 'owned' by both non and musical people, comes a slew of playground responses.
- maroonblazer 3y agoAs a musician, I'm waiting for the Copilot for music, which this is not. I.e., I want to define the 'problem'. In musical terms: I have an idea, it's 8 bars, maybe 12 or 16. I don't like what's happening at bar x. Give me 3/5/7 options for something different, but maintaining the instrumentation/orchestration I've established. Give me some "temperature" controls to depart, or not, from what I've composed thus far. Etc, etc.
- rhelsing 3y agoWe are working on this at https://neptunely.com https://neptunely.com
- d23 3y agoI'd take just having more control at a more granular level rather than having it try to generate a full song every time (e.g. generating just foley noises, or just a guitar melody, etc).
- belorn 3y agoSince copilot was announced I have been looking for someone to do similar for music. It will be fun when people can start seeding/prompting the tool in just the right way to have it reproduce copies of copyrighted music. It will be one of the more funny and novel way to lossy encoding music.
- sitkack 3y agoAn LLM should be able to handle this. I have used it to remix midjourney prompts. They currently suffer a little bit in temporal and spatial reasoning. And I just checked, GPT4 will "make music" in ABC notation, nothing like "Tropical House 120BPM" tho. It is pretty lousy artistically, that it can do it at all is absolutely amazing. Here is a remix of Cooley's https://web.archive.org/web/20230513053704/http://pastie.org/p/3VdLKsSa6FIi8k5hnp6rW4 https://web.archive.org/web/20230513053704/http://pastie.org... which is the only ABC notation song that doesn't sound like ____ https://abc.rectanglered.com/ https://abc.rectanglered.com/ GPT4's remix has me in stitches!
- squeaky-clean 3y ago
- SeanAnderson 3y agoGot in through the waitlist in a couple of hours. Told it "bass heavy dubstep to rock out to at a festival late at night" and got this: https://share.getcloudapp.com/L1uDmyGB https://share.getcloudapp.com/L1uDmyGB I'm impressed! :D
- theage 3y agoHere's a full length lofi album made with MusicLM. https://soundcloud.com/memorecks/sets/the-birth-of-aifi https://soundcloud.com/memorecks/sets/the-birth-of-aifi Falls apart at times though a big step above riffusion ibiza 3am late night lofi which wowed the world 5 months ago.
- naet 3y agoI was excited to try it but all the outputs I've gotten feel pretty similar, and it doesn't do many of the things I wanted it to do. I tried things like "make a beat using samples from a telephone ringing" and it wasn't able to generate anything like a real world sample. "trash metal played on a nylon string guitar" was a weird bongo sounding jam. "trumpet playing over a folk rock riff" offered one output with no trumpet that sounded like a harpsichord playing random notes, the second sounded like some kind of smooth flamenco inspired jazz played by a full combo. I think that something like this could be awesome given the right training data and model but this isn't quite there yet.
- bookofjoe 3y agohttps://news.ycombinator.com/item?id=35904393 https://news.ycombinator.com/item?id=35904393
- marketingLizard 3y agoIs this available in Canada, Australia and the EU?
- john61 3y agoThere is a saying "Writing about music is like dancing about architecture". Spoken language is unsuitable to express musical ideas.
- Jeff_Brown 3y agoAttributable to Frank Zappa
- up2isomorphism 3y agoIt sounds very very bland, just like LLM generated articles. But we have a much higher tolerance for bland articles.
- vrglvrglvrgl 3y ago[dead]