6 ms·

Demo: https://google-research.github.io/seanet/musiclm/examples/ https://google-research.github.io/seanet/musiclm/examples/

zan2434 4y ago
This should replace the OP link
winrid 4y ago
The vocals (on second page of table) are really interesting. If you walked into a club, you might not notice they are nonsense, but it's just good enough BS to be convincing.
- oidar 4y ago
  I just popped in to mention that part. It kinda feels like when Dalle generates text - like from a distance you recognize it, but it is utterly gibberish. It's interesting because there are certain parts of machine generated outputs we zero in on - for image generation it's typically eyes and, if it has it, text. It will be interesting to watch what evolves as tell-tale sign for computer generated things.
  - LukaszWiktor 4y ago
    Eyes or rather hands?
modeless 4y ago
I love that there's a whole section for accordion examples. I think the accordion rap has a bad word in it. Accordion techno works surprisingly well. They really need to bump up to 48 KHz so all the music doesn't sound like it's being played over a telephone. A factor of two in the cost shouldn't be prohibitive. So much of the audio generation stuff I've seen has fatal flaws like this baked into the dataset and/or training process that ensure the output can't sound good even in theory, it's kinda frustrating. It's also frustrating that nobody AFAIK has trained a music model on an actually large dataset. We're training large language models on a significant fraction of the text of the whole internet! Where are the audio models trained on a significant fraction of all recorded music? This one was trained (in part) on a dataset of 280k hours of music, if I read the paper correctly. I don't think that comes anywhere close to being a significant fraction of all recorded music.
- jonas-w 4y ago
  The "problem" is copyright, the music industry has way more power than the people that were copyright infringed by Stable Diffusion et al. And probably no artist that makes a living from their music will voluntarely give his music to AI.
  - makingstuffs 4y ago
    They should be able to get a significant amount of royalty free music. Granted it will generally be of a lower quality and/or be older but it should still be more than significant.
  - 5040 4y ago
    Pirates will gladly provide that content to the AI. Look what's happening with deepfakes.
- sterlind 4y ago
  are there upscalers in the wavenet world like there are in convnets?
- adriand 4y ago
  This is the best music that incorporates AI that I have heard by a long shot - process is here: https://ooo.ghostbows.ooo/about/ https://ooo.ghostbows.ooo/about/ Music is on all the usual streaming platforms, the album is called Shadow Planet, band is The Cotton Modules. Also avail on their website: https://ooo.ghostbows.ooo/ https://ooo.ghostbows.ooo/
beefman 4y ago
Totally fails on "swing" and "relaxing jazz".
redox99 4y ago
MusicCaps dataset: https://www.kaggle.com/datasets/googleai/musiccaps https://www.kaggle.com/datasets/googleai/musiccaps
deleted 4y ago
[deleted]
isoprophlex 4y ago
Holy hell those are insanely good. Best generated music I've heard so far. I was born too soon to explore the stars, born too late to be a 17th century pirate... but born just in time to explore these incredible neural networks come to life.
epistemer 4y ago
Epic soundtrack using orchestral instruments is somewhat interesting as electronic music but to me everything else is pretty bad. There is a million Industrial techno sounds, repetitive, hypnotic rhythms IDM tracks that absolutely no one listens to anymore. Most the founders of the whole genre have moved on from lack of interest. We have been able to do really good generative music in Reaktor for the last 20 years. Much better than anything on this page but no one cares. People in general want to hear the same slight variation in music over and over as background noise. The people that are saying how great all this is will be bored with it in 2 weeks or less. Pure technological kitsch.
- CuriouslyC 4y ago
  Let's be clear, this is a tech demo, the application is not going to be prompting infinite streams of low quality music. The application of this stuff is to enable creative tools (got a beat and some vocals, give me a bassline and backing chorus), real time computer jam partners, to provide "good enough" music for indie games/movies. These models are still in their early phases - If AI was combustion engines, we wouldn't even be to railroads yet. Despite that, they're still fun to play with and useful when used correctly.
  - tomdell 4y ago
    There are tons of relatively cheap music libraries with human-composed and human-produced music that is vastly higher quality than MusicLM's output - they are used for documentaries/commercials/low-budget projects and are loaded with metadata that make it easy for directors and editors to quickly find what they are looking for. Low-quality, weird-sounding AI-generated music with wonky rhythms, an inconsistent beat, bizarre digital artifacts and a generally unpleasant lo-fi sound that probably has to be patiently generated and listened to over and over again to find a usable result is highly unlikely to beat out already very cheap, much higher-quality and easily searchable human-written music for even the lowest budget projects.
- chasing 4y ago
  Yeah, as far as electronic music goes, maybe people don't realize just how good (and automated) the current tools are. And have been for years.
whoomp12342 4y ago
dope, can it queue up weird al? I am curious how generative would work at coming up with parody

zan2434 4y ago

This should replace the OP link

winrid 4y ago

The vocals (on second page of table) are really interesting. If you walked into a club, you might not notice they are nonsense, but it's just good enough BS to be convincing.

oidar 4y ago
I just popped in to mention that part. It kinda feels like when Dalle generates text - like from a distance you recognize it, but it is utterly gibberish. It's interesting because there are certain parts of machine generated outputs we zero in on - for image generation it's typically eyes and, if it has it, text. It will be interesting to watch what evolves as tell-tale sign for computer generated things.
- LukaszWiktor 4y ago
  Eyes or rather hands?

modeless 4y ago

I love that there's a whole section for accordion examples. I think the accordion rap has a bad word in it. Accordion techno works surprisingly well. They really need to bump up to 48 KHz so all the music doesn't sound like it's being played over a telephone. A factor of two in the cost shouldn't be prohibitive. So much of the audio generation stuff I've seen has fatal flaws like this baked into the dataset and/or training process that ensure the output can't sound good even in theory, it's kinda frustrating. It's also frustrating that nobody AFAIK has trained a music model on an actually large dataset. We're training large language models on a significant fraction of the text of the whole internet! Where are the audio models trained on a significant fraction of all recorded music? This one was trained (in part) on a dataset of 280k hours of music, if I read the paper correctly. I don't think that comes anywhere close to being a significant fraction of all recorded music.

jonas-w 4y ago
The "problem" is copyright, the music industry has way more power than the people that were copyright infringed by Stable Diffusion et al. And probably no artist that makes a living from their music will voluntarely give his music to AI.
- makingstuffs 4y ago
  They should be able to get a significant amount of royalty free music. Granted it will generally be of a lower quality and/or be older but it should still be more than significant.
- 5040 4y ago
  Pirates will gladly provide that content to the AI. Look what's happening with deepfakes.
sterlind 4y ago
are there upscalers in the wavenet world like there are in convnets?
adriand 4y ago
This is the best music that incorporates AI that I have heard by a long shot - process is here: https://ooo.ghostbows.ooo/about/ https://ooo.ghostbows.ooo/about/ Music is on all the usual streaming platforms, the album is called Shadow Planet, band is The Cotton Modules. Also avail on their website: https://ooo.ghostbows.ooo/ https://ooo.ghostbows.ooo/

beefman 4y ago

Totally fails on "swing" and "relaxing jazz".

redox99 4y ago

MusicCaps dataset: https://www.kaggle.com/datasets/googleai/musiccaps https://www.kaggle.com/datasets/googleai/musiccaps

deleted 4y ago

[deleted]

isoprophlex 4y ago

Holy hell those are insanely good. Best generated music I've heard so far. I was born too soon to explore the stars, born too late to be a 17th century pirate... but born just in time to explore these incredible neural networks come to life.

epistemer 4y ago

Epic soundtrack using orchestral instruments is somewhat interesting as electronic music but to me everything else is pretty bad. There is a million Industrial techno sounds, repetitive, hypnotic rhythms IDM tracks that absolutely no one listens to anymore. Most the founders of the whole genre have moved on from lack of interest. We have been able to do really good generative music in Reaktor for the last 20 years. Much better than anything on this page but no one cares. People in general want to hear the same slight variation in music over and over as background noise. The people that are saying how great all this is will be bored with it in 2 weeks or less. Pure technological kitsch.

CuriouslyC 4y ago
Let's be clear, this is a tech demo, the application is not going to be prompting infinite streams of low quality music. The application of this stuff is to enable creative tools (got a beat and some vocals, give me a bassline and backing chorus), real time computer jam partners, to provide "good enough" music for indie games/movies. These models are still in their early phases - If AI was combustion engines, we wouldn't even be to railroads yet. Despite that, they're still fun to play with and useful when used correctly.
- tomdell 4y ago
  There are tons of relatively cheap music libraries with human-composed and human-produced music that is vastly higher quality than MusicLM's output - they are used for documentaries/commercials/low-budget projects and are loaded with metadata that make it easy for directors and editors to quickly find what they are looking for. Low-quality, weird-sounding AI-generated music with wonky rhythms, an inconsistent beat, bizarre digital artifacts and a generally unpleasant lo-fi sound that probably has to be patiently generated and listened to over and over again to find a usable result is highly unlikely to beat out already very cheap, much higher-quality and easily searchable human-written music for even the lowest budget projects.
chasing 4y ago
Yeah, as far as electronic music goes, maybe people don't realize just how good (and automated) the current tools are. And have been for years.

whoomp12342 4y ago

dope, can it queue up weird al? I am curious how generative would work at coming up with parody