3 ms·
It’s called a vocoder. It allows for (for instance) a monotone-sung piece of text to follow a set of midi notes, by modulating it using a carrier wave (I think.
by jeffhuys 3y ago
It’s called a vocoder. It allows for (for instance) a monotone-sung piece of text to follow a set of midi notes, by modulating it using a carrier wave (I think. Please correct any inaccuracies!).
I use it sometimes in FL Studio when creating electronic music (plugin is called Vocodex).
Presumably they take the AI-generated voice and generate midi notes, and apply a vocoder to the voice, following the notes.
- guitarlimeo 3y agoI think that's just an artifact, as they can also produce heavy metal scream singing etc. It just mimics something that was in the training data. My guess is that they train the vocals and the music separately, the training data is trivial to create from any tracks with tools like with https://vocalremover.org/ https://vocalremover.org/.