15 ms·
MuseNet
- rmbryan 7y agoMuseNet will play an experimental concert today from 12-3p PT livestreamed on our Twitch channel. No human (including us) has ever heard these pieces before, so this will be an interesting showcase of MuseNet’s strengths and weaknesses. Through May 12th, we’re also inviting everyone to try out our prototype MuseNet-powered music generation tool.
- alexisnorman 7y agoIs the tool out yet? Not sure if I'm missing a link somewhere on that page. Excited to try this out!
- deleted 7y ago[deleted]
- gdb 7y agoTool is embedded in the blog post: https://openai.com/blog/musenet/#try https://openai.com/blog/musenet/#try!
- daeken 7y agoI really, really want to see a live band or orchestra play a set of AI-composed pieces, none of which were filtered or manipulated by humans. Just generate MIDI, spit out sheet music (hopefully written well enough that it can be sight-read), and hope for the best. I'd buy a ticket for that, without a doubt!
- gdb 7y agoWe'll be playing generated MIDI without human filtering or manipulation today (though playing them synthetically of course)! If you know of an orchestra looking for some music, we could do the rest of what you describe :).
- DanAndersen 7y agoPerhaps an AI-assisted version of Ben Folds' "composing a symphony on-stage"? [0] [0] https://www.youtube.com/watch?v=BytUY_AwTUs https://www.youtube.com/watch?v=BytUY_AwTUs
- lxe 7y agoLooks like there's no sound in the channel.
- sgrove 7y agoDirect link for those who are hoping to listen https://www.twitch.tv/openai https://www.twitch.tv/openai
- icelancer 7y agoAt 2:08 PM PT, the Mendelssohn track was unbelievably good. I'm incredibly impressed.
- craze3 7y agoDamn, I was just about to code this! Generative music is definitely on the come-up. If you like this, also check out https://generative.fm/ https://generative.fm/ , which is from another HN member.
- zitterbewegung 7y agoYea I had the same idea trying to use midi on gpt-2.
- spaceheretostay 7y agoI wonder if, with OpenAI's state-of-the-art text synthesis, they could 'relatively' easily add stories with words and lyrics into this music.
- CamelCaseName 7y agoI think https://brain.fm https://brain.fm also came out of HN. I've used it once or twice, but for whatever reason, nothing sounds better to me than the music I used to listen to when I was a teenager.
- bduerst 7y ago>nothing sounds better to me than the music I used to listen to when I was a teenager. Tangental, but listening to the music from your teen years is a form of therapy for people who developed dementia. It's possible the music we impress in our teen years hold a special value in our brains.
- ipsum2 7y agoNeat output, the project is very similar compared to the Google Doodle a few weeks back, where they generated music based off of user-submitted notes. https://www.google.com/doodles/celebrating-johann-sebastian-bach https://www.google.com/doodles/celebrating-johann-sebastian-... Since this is OpenAI, is MuseNet open source?
- gdb 7y agoNot yet, but we plan to release the code & pre-trained model!
- dharma1 7y agoWhat kind of hardware (and what size data set) would you need to train with new types of music? Doable with a single 1080ti and a couple of hundred midi files? Also, can you do supervised learning with this - say melody input and chords (with good voice leading) output?
- IBCNU 7y agoHuman interaction has so much potential - speaking as a musician here this is exciting.
- gwern 7y ago> Doable with a single 1080ti and a couple of hundred midi files? A 1080ti would probably require something like several days or a week. It depends on how big the model is... Probably not a big deal. However, a few hundred MIDI files would be pushing it in terms of sample size. If you look at experiments like my GPT-2-small finetuning to make it generate poetry instead of random English text ( https://www.gwern.net/GPT-2 https://www.gwern.net/GPT-2 ), it really works best if you are into at least the megabyte range of text. Similarly with StyleGAN, if you want to retrain my anime face StyleGAN on a specific character ( https://www.gwern.net/Faces#transfer-learning https://www.gwern.net/Faces#transfer-learning ), you want at least a few hundred faces. Below that, you're going to need architectures designed specifically for transfer learning/few-shot learning, which are designed to work in the low _n_ regime. (They exist, but StyleGAN and GPT-2 are not them.)
- asparagui 7y agoCool stuff, Christine!
- rco8786 7y agoThis seems incredibly applicable to musical scores in movies. I can imagine a product where the editor/director/someone inputs a handful of variables (mood, genre, instruments, etc) and timing requests (crescendo beginning at 30s and ending at 75s, calm period from 90s - 120s, etc) and out comes a musical score for the movie that matches up with their scene editing.
- sonnyblarney 7y agoAnd do the same for the actors, script, lighting and sound effects. And also have some AI for the 'input variables', after all Netflix already does that to select their content. And then we'll have Utopia!
- danpalmer 7y agoIt might be a way off that for "production", but for editing, when a score isn't finished yet, as filler to help the editing process, this could be an amazing tool.
- wilg 7y agoMaybe more interesting for video games, where you can have a realtime input of gameplay variables.
- z2 7y agoThere have been covers of people taking a pre-recorded segment of a game (say, a 1v1 fight), and improvising a jazz score around it. How awesome would it be to have this happen live for any game? Anything from mood to specific sound effects.
- fastball 7y agoThat could be very interesting. Every gameplay a different soundtrack. Sounds fun.
- bredren 7y agoContrast with this very human representation of writing gameplay musical scores. Including the simple chart used to show segued clips. http://www.audiogang.org/chance-thomas-composer-of-dota-2s-2018-battle-pass/ http://www.audiogang.org/chance-thomas-composer-of-dota-2s-2...
- deleted 7y ago[deleted]
- deleted 7y ago[deleted]
- 0815test 7y agoNot very impressive/interesting, they aren't releasing their code or models, and it seems that they had to use lots of rather obscure hacks to make the whole multi-instrument thing work. (Though I suppose it definitely is impressive in other ways, especially hacking their existing GPT architecture to do something worthwhile with non-text tokens. So, I'm not saying that any sort of work should be dismissed outright!) I do still think that the good old https://github.com/hexahedria/biaxial-rnn-music-composition https://github.com/hexahedria/biaxial-rnn-music-composition (Hexahedria's Biaxial RNN/Tied Parallel Networks, also published a paper achieving SOTA at least for that time, on a variety of midi datasets) has more interesting/compelling output musically, despite starting from a comparatively tiny dataset and using rather elegant and easily-undestandable convolution- and RNN-based techniques. Too bad that the implementation relies on Theano which is quite endangered at this point (doesn't seem to support up-to-date python 3?), but I do think it's a compelling starting point if anyone really wants to work on this domain.
- deleted 7y ago[deleted]
- DannyB2 7y agoAm I remembering correctly that in Orwell's 1984 (the book), music and poetry was created by machines?
- hoseja 7y agoYes, all this effort to generate music, with disappointing, lifeless results, is somewhat disturbing.
- Areading314 7y agoThis may be academically interesting, but the music still sounds fake enough to be unpleasant (i.e. there's no way I'd spend any time listening to this voluntarily).
- spaceheretostay 7y agoHow does it sound fake? It sounds lovely to me, especially much of the Chopin+pop piece sampled in the article.
- tunesmith 7y agoLack of narrative. It's less disturbing if you're in the mode of listening to background music, but for active listening, classical music is so much richer.
- deleted 7y ago[deleted]
- isolli 7y agoI believe they selected some of the best-sounding pieces. Playing with their tool (which is a lot of fun) is more hit-and-miss: some interesting results, but also some slightly unpleasant music.
- 0815test 7y agoYup, this is why I said that the output is somewhat uninteresting musically - there are actually machine-learning music models that do a lot better from that POV, despite being seemingly unambitious in many other ways. (I've mentioned one elsewhere in this thread, but BachBot and DeepBach also deserve mention!)
- diehunde 7y agoYes, the lack of human factor is very noticeable if you are a musician. I believe it's pretty similar to when grandmasters can tell if they are playing a human or a bot. Something that's hard to explain. Now saying if it's better or worse is just subjective.
- ctoth 7y agoWas any of the work from https://openai.com/blog/sparse-transformer/ https://openai.com/blog/sparse-transformer/ incorporated in this?
- deleted 7y ago[deleted]
- GistNoesis 7y agoNice. We played a little with transformers inside a browser using tensorflow.js a few month ago, for real-time music transcription. For those interested : Website : https://gistnoesis.github.io/ https://gistnoesis.github.io/ Project : https://github.com/GistNoesis/Wisteria/ https://github.com/GistNoesis/Wisteria/ My project is currently on hold, but will definitely receive update in the future. As it's kind of project for fun with no hope of monetization given that the space is already crowded with Google's Magenta, and now OpenAI is joining the dance with museNet.
- dom96 7y agoPretty cool. Ludum Dare is coming up and this would actually be a pretty nice way to generate some music.
- ericye16 7y agoSomething I'm curious about: If I make some music I really like through this tool, do I own the copyright to that? Can I turn generated music into an album and sell it? I'm not sure if the site does caching but if it does and me and another person generate the same music, do we both own rights to that?
- Erwin 7y agoI think it will be interesting to see whether there's a legal difference between a person, being inspired by obviously copyrighted material and creating something similar or a Machine Learning model that is trained by the same. If I look at the Marvin Gaye Blurred Lines case: https://en.wikipedia.org/wiki/Blurred_Lines#Marvin_Gaye_lawsuit_and_authorship_questions https://en.wikipedia.org/wiki/Blurred_Lines#Marvin_Gaye_laws... that took years to resolve involving humans, I wouldn't personally risk to release machine-generated music that was trained on copyrighted music.
- gwern 7y agoI got this question a lot about my StyleGAN anime faces & GPT-2-small poetry: https://www.gwern.net/Faces#faq https://www.gwern.net/Faces#faq The legal consensus, such as it is, seems to be that (if you did not otherwise agree to a contract/license modifying this in arbitrary ways) you create a new copyright & own it if you use their music-editing tool to tweak settings until you got something you liked, because you are exercising creative control, making choices, and engaging in labor. On the other hand, if you merely generated a random sample, neither you nor anyone else own a copyright on it.
- occamschainsaw 7y agoHow do you prove that too? Maybe in the future somebody creates a random painting in FuturePaintGAN(TM)+3DCanvasPrinter(TM) that moves millions of people to tears and sells for hundreds of thousands in some auction house. Is that their IP? What if that person is a monkey[1]? Is it "animal-made art"[2]? [1] https://en.wikipedia.org/wiki/Pierre_Brassau https://en.wikipedia.org/wiki/Pierre_Brassau [2] https://en.wikipedia.org/wiki/Animal-made_art https://en.wikipedia.org/wiki/Animal-made_art
- z3t4 7y agoHave anyone attempted to make a code autocomplete or snippet/boilerplate generator using this !? Would be nice when coding on mobile where its hard to navigate between code and navigation due to the small screen.
- revskill 7y agoI always think, to be a better programmer requires a better understanding of art and science. From literature, music, physics,... everything unrelated to the computer itself. That's why every IT book needs more knowledge to teach users how to really understand art and science behind everything we experience.
- modeless 7y agoI think this is far, far beyond any algorithmic composition system ever made before. It displays an impressive understanding of the fundamentals of music theory. Most previous attempts at neural net composition restricted the training set to one style of music or even one composer, which is pretty silly if you understand how neural nets work. It was obvious to me if you used a very large network, chose the right input representation, and most importantly used a complete dataset of all available music, you would get great results. That's exactly what OpenAI has done here. It is still lacking some longer term structure in the music it generates (e.g. ABA form). But I think simply scaling up further (model and dataset size both) could fix that without any breakthroughs. This seems to be OpenAI's bread and butter now: taking existing techniques and scaling them up with a few tweaks. (To be clear, I don't mean to minimize what they've done at all. "Simply" scaling up is not so simple in reality.) What might still need some breakthroughs is applying the same technique to raw audio instead of MIDI. Perhaps what is needed is a more expressive symbolic representation than MIDI. I'm imagining an architecture with three parts: a transcription network to produce a symbolic representation (perhaps embedding vectors instead of MIDI), something like this MuseNet for the middle, and a synthesis network to translate back to raw audio. This would be analogous to gluing together a speech recognizer, text processing network, and a speech synthesizer. Such a system could generate much more natural sounding music, even perhaps with lyrics.
- CupOfJava 7y agoopenai says they can do it: Long-term structure MuseNet uses the recompute and optimized kernels of Sparse Transformer to train a 72-layer network with 24 attention heads—with full attention over a context of 4096 tokens. This long context may be one reason why it is able to remember long term structure in a piece
- make3 7y agothe problem to the scaling thing is that we don't nearly have as many samples per artist as we do have "text pointed to by links on reddit", as used in GPT2 (openAi's text generation thing). I would expect that they can't go as crazy as they could
- p1esk 7y ago
- ucha 7y agoWhile I admire the effort, the music sounds quite unpleasant... Jukedeck has significantly better AI generated music but since I have not found a description of how their model works, it is hard to compare it to this.
- deleted 7y ago[deleted]
- jefftk 7y agoI don't know the other genres well enough to evaluate them, but the bluegrass one (https://soundcloud.com/openai_audio/genre-bluegrass https://soundcloud.com/openai_audio/genre-bluegrass) is pretty bizarre: * Who uses piano as the lead instrument in bluegrass? * They're only using one one note velocity for the whole piece, which misses a huge wealth of variation through rhythmic accent. * Timing generally feels a bit robotic? * The best parts it sounds kind of ok but boring; in bad parts it sounds like nothing (https://soundcloud.com/openai_audio/gaga-beatles https://soundcloud.com/openai_audio/gaga-beatles is even worse that way) * A lot of the artificiality seems to be the synth they're using. * On the other hand it does understand a bit about phrasing and repetition, which many people new to traditional music take a long time to pick up.
- throwaway66666 7y agoIt's midi. It's meant to be notation, not a realistic composition. I suppose the background "machine gun" piano notes would be a bassy synth combined with 90s electronic music drums. So please do not focus that much on the audio or performance part of it, but on the composition part of it. I do agree they could have trained it about the importance of velocity though. (That neural net, and most young music students out there too, heh)
- jcims 7y agoDo you think there was enough velocity info in the training corpus?
- throwaway66666 7y agoInteresting question. I would assume yes. There should be enough data for things like sustain pedal and velocity dynamics. Music people can be "crazy" and add a lot of detail in their work. It is pretty common to find midi renditions of pieces that contain all kinds of extra information, from pitch shift cues for guitar solos to legato for string instruments (when the finger slides across the string, instead of "jumping" from position to position), to even volume automation for fade in/out effects. Classical musical notation also contains it, though way more limited than the 0-127 range of MIDI, in the piano/forte dynamics notation. It might have been stripped off to ease complexity, or maybe it was unadequate and created odd sounding results. Maybe the midi library they used doesn't do a good job of portraying it and it is actually there! Who knows!
- nickelcitymario 7y agoThis was literally a plot point in the last episode of American Gods. So the turn-around time from sci-fi to reality is... less than a week now?
- ohiovr 7y agoCan it make ukulele music? Perfect for youtube ads that must have obligatory music complete with the drone in the background "Pond 5.... Pond 5..." and the producer can't pitch in 5 bucks for it.
- codelitt 7y agoWhile this may not be perfect composition, this is a surreal (and almost sad) moment in my life to hear music that is passable created by a computer under it's own volition. I work at a company that works with a lot of machine learning so I generally understand its limitations and haven't ever been an alarmist. That being said, I generally always thought of it being applied to automate work. For some reason I had always considered that which we normally attribute to human creativity to be off-limits. Sure now it's not great, but in 10 years will it be able to compose better music than Chopin? In 10 years, will music created by a computer surprise and delight me more than music composed by humans?
- 0815test 7y agoIt doesn't sound passable to me - it sounds boring, it's a hack around a text-parsing architecture ffs, trying to make it understand multi-dimensional and multi-timbral data... There are models that do better, and can "surprise and delight" you in different ways than a human would. Think about DeepDream and the whole experience of trying to spot all the weird doggie parts that the computer manages to sneak in those pictures - I don't think that a human could paint a DeepDream-dog picture nearly as effortlessly and perfectly as a computer can! I would definitely describe that as successful art, as far as it goes. But that doesn't mean that DeepDream "solves" visual art as a task!
- meesles 7y agoFear not, my friend, because the execution is only a part of why music and art as a whole carries meaning for us. Consider two tracks that are identical (forget copywrite for a minute). Between one that an AI generated and a human composed, I would personally grant the human-generated version more credit and enjoy it more. The story of how art is created and the stories of the artist are as substantial to appreciating art as a stroke of a brush or a note on a page. Computers will never replicate this until singularity.
- arcticfox 7y agoFirst of all, I disagree with this premise, as the overwhelming majority of music either (1) doesn't have a particular story behind it at all or (2) becomes popular, and then people learn the story behind it. Even accepting the premise, what happens when the next artist with a great story is simply using MuseNet to write their emotional pieces and passing it off as human? They'll be functionally the same, yet it still feels like something was lost.
- rambojazz 7y agoIs this open source?
- CuriouslyC 7y agoI'm very into both music composition/production and ML, so this is neat. That being said, I think the "computer generated music" path is probably the wrong approach in the short term. Music is really complex and leans heavily on both emotions and creativity, which aren't even on the radar for AI. Being able to dynamically remix and modulate existing music is still really cool though. I would kill for a VST tool that would take a set of midi tracks, and synthesize a new track for a specific instrument that "blends" with them. I would also kill for something that can take a set of "target notes" and break them up/syncopate/add rests to produce good melodies, or take a base melody and suggest changes to spice it up.
- imdsm 7y agoTo be fair, I recently watched a video with Dr Hannah Fry in which she played real vs AI music samples, and while the real human music was more complex, the AI composed music, though simpler, was still good and at first, hard to pick out.
- leesec 7y ago>Music is really complex and leans heavily on both emotions and creativity, which aren't even on the radar for AI. I definitely think creativity is on the radar for AI, see: AlphaGo. Everything we think is based on emotions is ultimately learnable.
- CuriouslyC 7y agoI don't think alpha go is a good example here. It play with strange brilliance, but I wouldn't call that creativity. If you care to elaborate on why you said this I'm curious to hear your rational. To me, creativity is really about generation of "aesthetic novelty" which is hard to get from a ML algorithm that is trying to approximate patterns in training data. Eventually, there will be models trained on a wide variety of art, music, stories, etc that can recognize aesthetic and structural isomorphism between mediums (say between a grizzly picture and death metal), then we'll lose our competitive advantage. I don't think we're nearly so close to that as the singularity types would have us believe though.
- dillondoyle 7y agoCan someone live stream to Twitch, collect likes or comments, and then feed back and make a GAN trained on our collective response to the musical output? I would LOVE to see where that goes... Is it going to turn into 4 chord pop? Or maybe more dominant, more resolve-y? Or maybe my assumptions will be wrong and we would collectively train for more complex music?
- nate 7y agoAs an amateur video producer constantly on the lookout for even some basic (as in not grammy winning, or even "artist" quality) music to add to my work that I don't have to pay a fortune to license, but don't want it to be incredibly unoriginal, this path has me excited.
- brilee 7y agoMy take on the classical parts of it, as a classical pianist. Overall: stylistic coherency on the scale of ~15 seconds. Better than anything I've heard so far. Seems to have an attachment to pedal notes. Mozart: I would say Mozart's distinguishing characteristic as a composer is that every measure "sounds right". Even without knowing the piece, you can usually tell when a performer has made a mistake and deviated from the score. The mozart samples sound... wrong. There are parallel 5ths everywhere. Bach: (I heard a bach sample in the live concert) - It had roughly the right consistency in the melody, but zero counterpoint, which is Bach's defining feature. Conditioning maybe not strong enough? Rachmaninoff: Known for lush musical textures and hauntingly beautiful melodies. The samples got the texture approximately right, although I would describe them more as murky more than lush. No melody to be heard.
- varelse 7y agoFunny, as someone with the useless superpower of knowing an enormous number of TV Show themes, I could hear all sorts of riffs on such themes ranging from Magnum PI to Sesame Street. Overall, IMO it wildly gyrates from the best I have ever heard all the way to the return of Microsoft's thematically lifeless Songsmith without warning... https://en.wikipedia.org/wiki/Microsoft_Songsmith https://en.wikipedia.org/wiki/Microsoft_Songsmith
- ctchocula 7y agoThis is very interesting to me as an amateur pianist trying to learn Bach. Could you give an explanation of what good and bad contrapuntal playing sound like or direct me to some references?
- mises 7y agoI think this has great potential for content creators and their use of royalty-free music. It might just help a lot of the big copyright issues, and distinguish each person's work with a distinct score.
- SubiculumCode 7y agoSeems to have a hard time being the fifth Beatle. I couldn't even get a cheap Beatles feel, much a sublime melody. However, some of the piano pieces are pleasant.
- csomar 7y agoHow does licensing work here? Do they have the right to "merge" that music into their neuronal weights? Is there a specific license for usage in a neural net?
- ArekDymalski 7y agoThe legal situation of such music has been recently described as: https://futurism.com/ai-generated-music-legal-clusterfuck https://futurism.com/ai-generated-music-legal-clusterfuck
- elihu 7y agoI expect the next major copyright law legal battle will be around the question of whether content generated by some machine learning approach that was trained on copyrighted data is a derivative work or not.
- bufferoverflow 7y agoProving that a certain piece was generated from a certain dataset will be a huge obstacle. Heck, proving a piece was generated would be hard.
- dpcan 7y agoAs a web developer, all these "do it yourself" website systems make me sick. The end results look amateur and messy most of the time, and it's an insult to the industry to give people with no visual or code-based skills the tools to create sub-par websites. I'll bet talented musicians and real composers feel the same about MuseNet. The music probably makes them cringe to their core. Then there is the general public... They don't notice anything wrong with do-it-yourself websites, and this music sounds amazing.
- TaupeRanger 7y agoQuite true. I've found this to be the case with almost every "composition AI" system ever created, with the exception of those that aid human composers, such as those designed by David Cope.
- mrfusion 7y agoWhat makes this different than those markov chain models people used to use to generate nonsensical papers that sound real?
- uptownfunk 7y agoWhat speaks to me here is this is one of the closest things we have to creativity in AI and while AGI is a ways away, this is a key step, even though it may not seem like some hard tech we can put to use in industry immediately. I think it’s a subtle distinction, but imagine a model where we can throw in thousands of math proofs then give the model some initial assumptions and just let it run wild. I think getting a neural net to model the creative spark / the ingenuity is what has been missing. A part of me doesn’t want to believe that it is possible, but a part of me is genuinely curious as to the consequences. An exciting time to be alive, folks.
- Ericson2314 7y agoAs a sometimes composer, the thing that makes me most sad about this stuff is it's all computer or no computer. Deep learning with symbolic stuff is still in it's infancy, so I don't expect to really mix this with hand-composed stuff anytime soon. As far as I understand it as a layman, the way the input is compressed for learning is also how it's fed the sample, so there's no way to "pay more attention" to the piece your augmenting than the pieces in the training data.
- Gimpei 7y agoFeels like this kind of thing would be useful for generating better jazz backing tracks. The programmatic backing tracks you get these days are good, but can be really repetitive. I wonder if there's some way to force the model to follow changes.
- ArtWomb 7y agoWondering if synthesizing a single instrument rather than an entire MIDI file might be better, as each note could be evaluated via finite differentials. Transformer would use as input a single note from say violin or guitar. And "translate" the pitch and envelope to the new sounds. The physical simulation of music, rather than notational logic. Problem of long range order in the composition still remains unsolved, unless the model accounts for the importance of transitions in music theory. In Neural Machine Translation, characters, words, even grammatical rules themselves can pre-define such an implicit structure. Enjoyable to the trained mind to be sure. Especially as a moment in history. But the tunes themselves lack soul. And jarring for myself as the background music I had turned off to catch the tail end of MuseNet's performance, was of a particularly feverish level of human expressiveness ;) Bad Brains - Live at the CBGB's 1982 (Full Concert) https://www.youtube.com/watch?v=2pUlNfdnsAM https://www.youtube.com/watch?v=2pUlNfdnsAM
- daveheq 7y agoI just read today a tweet by one of the React Rally spokespersons how Hacker News is a toxic forum... yet it's the least toxic most data-oriented forums I've used in years.
- pvorb 7y agoSorry, but I can't take anyone seriously writing this on Twitter, the most toxic platform of them all.
- mzs 7y ago> RELENTLESS DOPPELGANGER \m/ \m/ \m/ \m/ \m/ \m/ \m/ \m/ \m/ \m/ \m/ \m/ \m/ \m/ https://youtu.be/CNNmBtNcccE https://youtu.be/CNNmBtNcccE > Neural network generating technical death metal, via livestream 24/7 to infinity. Trained on Archspire with modified SampleRNN. Read more about our research into eliminating humans from metal: https://arxiv.org/abs/1811.06633 https://arxiv.org/abs/1811.06633 > More albums https://dadabots.bandcamp.com/ https://dadabots.bandcamp.com/
- throwaway66666 7y agoDespite this being a cool feat. It sounds so close to the source material (down to parts of the songs being a lofi 1-1 copy paste), that I don't see a real point of it for even existing. (except "omg death metal neural nets lol" factor)
- gnahckire 7y agoWhen discussing this with my friends, an interesting question came up: Who owns the music this produces? Couldn't one generate music and upload that to Spotify and get paid based off the number of listens?
- pdxww 7y agoImpressive. Would this model benefit from something like "dilated attention"? Instead of feeding it raw sound samples, we could split the input into 16 sec, 8 sec, 4 sec and so on slices, assign each slice a "sound vector" serving as a short description of that slice and let the generator take those sound vectors as input. This should supposedly let it gain global consistency in output. Now an unpopular opinion. I'm not an ML expert, so take my words with reasonable skepticism. This fancy GPT2 model diagram can impress an uninitiated, but we are initiated, right? There is really no science there and it's still the good old numbers grinder: an input of fixed size is passed thru a big random pile of matrix multiplications and sigmoids and yields a fixed size output. We could technically replace this nice looking GTP2 model with a flat stack of matmuls and tanhs, with a ton of weights and given enough powerful GPUs (that would cost tens of millions), train that model and get the same result. It just won't make an impression of science. How are these GTP2 models designed? By somewhat random experiments with the model structure. The key here is the GPU datacenter that could quickly evaluate the model on a huge dataset. The breakthru would be achieving the same quality with very little weights.
- p1esk 7y agoInstead of feeding it raw sound samples, we could split the input into 16 sec, 8 sec, 4 sec and so on slices, assign each slice a "sound vector" serving as a short description of that slice and let the generator take those sound vectors as input. I didn’t quite get it. How would you feed this variable sized input?
- uuwp 7y agoThe same way we feed the variable size sequence of characters or sound samples into this RNN. Instead of raw samples at the 16 kHz rate, we'll have one sequence of 1 sample per second, another sequence of 1 sample per 0.5 seconds and so on. We can go as far as 1 sample per 1/48000 sec, but I don't think it's practical (but this is what these music generators do).
- p1esk 7y agoWhat do you mean by “sample” when you say “sequence of 1 sample per second”?
- peter_d_sherman 7y agoThis thing sounds awesome! After hearing it, I am truly amazed at the level to which AI has evolved! It's good music... Heck, it's not just good music, it's potentially borderline (with some tweaks by human professionals) great music! But, despite this potential greatness, if there's a problem, it's that this AI only produces music... What this AI composer really needs is an AI lyricist to write lyrics for the songs it composes! Sort of like an AI Lerner to it's AI Loewe... An AI Hammerstein to it's AI Rodgers... An AI Gilbert to it's AI Sullivan... An AI Tim Rice to it's AI Andrew Lloyd Weber... An AI Robert Plant to it's AI Jimmy Page... An AI Keith Richards to it's AI Mick Jagger... An AI Paul McCartney to it's AI John Lennon... An AI Bernie Taupin to it's AI Bernie Taupin... An AI James Hetfield to it's AI Lars Ulrich... An AI Wierd Al Yankovic... to it's... AI Wierd Al Yankovic... <g> You know, an AI Assistant for this... AI Assistant... <g> Well, an AI Assistant to write lyrics that is... An AI "Lyrcistant"... <g> Come on, I know there's someone in the AI world who can do this! But it might be a bit challenging... the AI would not only have to write poetry, but it would have to match that poetry to all of the various characteristics of the music... Not an easy task, to say the least! But, for the right AI researcher... an interesting, challenging, worthy one! (I think I hear 2001's "Daisy Bell" playing in the background...) By the way... disclaimer: I am an AI. That is, An AI wrote this message on HN. No, I'm kidding about that! But... how would you know? (insert ominous sounding music here) <g>
- davesque 7y agoML models that generate music continue to improve. However, to me, the result still just seems like a novelty and nothing more. Perhaps it will take much more iteration and improvement in compute power before I hear a piece of music that I find truly inspiring that was generated by an AI. On the other hand, I've been much more impacted by visual "art" already being generated by AIs. Perhaps the musical medium is ironically harder to crack since the format is simpler, rather like how it took longer for an AI to defeat an expert goban player than a chess player.
- p1esk 7y agoHave you seen a “truly inspiring” piece of visual art generated by AI?