5 ms·
Most of these no doubt are just websites, you can search for 'ai song generator'. Where you can input your lyrics, styles, etc. You can create all original son
by incomingpain 1y ago
Most of these no doubt are just websites, you can search for 'ai song generator'.
Where you can input your lyrics, styles, etc. You can create all original songs by having AI generate the lyrics even.
>Does anyone know what models and tools are used?
One of the best in my opinion: https://huggingface.co/tencent/SongGeneration https://huggingface.co/tencent/SongGeneration
One of the most popular: https://huggingface.co/facebook/musicgen-medium https://huggingface.co/facebook/musicgen-medium
The "transformers" is just a python library and you just add all the parameters in a constructor:
processor(
text=["80s pop track with bassy drums and synth", "90s rock song with loud guitars and heavy drums"],
padding=True,
return_tensors="pt",
)
This one can run on like 16GB of vram and modern cards produce them trivially.
>I imagine once you have stems you can maybe style / genre transfer and use a reference audio file perhaps?
You can do audio to audio; but it's not as easy as just generating the whole thing from text.
- afro88 1y agoAppreciate your response, thank you. I had a look at what you provided. The "ai song generator" websites and these models aren't able to genre transfer with the exceptional quality of the linked youtube channel. These have incredibly good alignment to the original songs, but the genre totally transformed. For example, the Nirvana one on that channel. Song structure is entirely preserved, as well as melodic and harmonic content. But the genre is transformed to 80s synth pop. It's the same for any recent upload to that channel.