6 ms·
Hang on, is this thing actually generating halfway intelligible rap? Utterly amazing.
by i_like_apis 4y ago
Hang on, is this thing actually generating halfway intelligible rap?
Utterly amazing.
- svantana 4y agoAs I read it, this is just a spectrogram-->pcm converter (in speech known as a vocoder), which you can do decently without a model, just pure optimization. The hard part is to generate the spectrogram, which I assume they will tackle next.
- woodson 4y agoWell, there’s Griffin-Lim, but there is a reason most recent work uses a trained neural vocoder.
- jjoonathan 4y agoIs it halfway intelligible rap or fully intelligible ghost rap?
- moralestapia 4y agoI also have this question and it's a bit more complicated for me as I'm not a native speaker + the accent is heavily skewed because of the nusic style. So, are there some real words in there? Do the lyrics make sense? Or is it just "random" vocalizations that go along with the song?
- gwern 4y agoNo, he's still just experimenting with the audio representation. However, you certainly can generate halfway intelligible rap, and much more, if you check out https://openai.com/blog/jukebox/ https://openai.com/blog/jukebox/ (with GPT-3 lyrics) or consider other kinds of audio synthesis like https://speechbot.github.io/dgslm/ https://speechbot.github.io/dgslm/ (fully end to end).
- durnygbur 4y agolol, thisrapdoesntexist.com
- zone411 4y agoIf you connect various steps of what can already be done well, such as melody generation (my project), lyrics generation, singing voice synthesis, chord generation, and various semi-automated VST plugins with generation features, you can create some good stuff already. Automating them completely is not even a huge leap forward but you'll still need to do some cherry picking of the results.
- songeater 4y agoshameless plug ging down this route: OpenAI Jukebox creating my singer/songwriter project... https://soundcloud.com/songshtr/sets/machinecroon https://soundcloud.com/songshtr/sets/machinecroon