4 ms·

What? Most of the voices I tried sound really intense, even angry. Very strange emotional flavors for what should be quite neutral text inputs. The laughing was

What? Most of the voices I tried sound really intense, even angry. Very strange emotional flavors for what should be quite neutral text inputs. The laughing was literally ha, ha, ha, ha. Not even remotely a genuine human laugh. The actual sound quality of the output is impressive (clear treble, no weird artifacts between syllables, etc.), but I just don't understand the weird "edginess" of the speech.

godelski 4y ago
I think their model poorly weights the spatial context in sentences. Humans speak with a little rhythm: cadence. The lack of cadence and emotion puts it in deep in the uncanny valley.
- ilaksh 4y ago
  They have a dial for stability and one for clarity. The stability one in particular when turned up reduces the expressiveness.
Savaaki 4y ago
Thats a pretty high bar, have you tried inputting ha ha ha into literally any other TTS engine? It never produces great results.
x-desire 4y ago
Yeah, when I tried their demo I was a bit confused too - it's not that impressive. But their model is really good when it comes to cloning voices from small audio samples. It was discovered by 4chan unfortunately [1]. I have only seen a few clips but all of them were racist, sexist or worse. Not appropriate to link them here, I guess. You can see an official sample on their YouTube channel [2]. However, the voices and conversations I've heard yesterday, other than being disgusting, were high quality, believable and full of emotions. The voices of Obi Wan Kenobi or Joe Biden sounded so genuine that it was creepy. I know there has been tools to deepfake voices for years now, but this is the first time I'm seeing one that sounds so authentic. [1]: https://www.theverge.com/2023/1/31/23579289/ai-voice-clone-deepfake-abuse-4chan-elevenlabs https://www.theverge.com/2023/1/31/23579289/ai-voice-clone-d... [2]: https://www.youtube.com/watch?v=17_xLsqny9E https://www.youtube.com/watch?v=17_xLsqny9E

godelski 4y ago

I think their model poorly weights the spatial context in sentences. Humans speak with a little rhythm: cadence. The lack of cadence and emotion puts it in deep in the uncanny valley.

ilaksh 4y ago
They have a dial for stability and one for clarity. The stability one in particular when turned up reduces the expressiveness.

Savaaki 4y ago

Thats a pretty high bar, have you tried inputting ha ha ha into literally any other TTS engine? It never produces great results.

x-desire 4y ago

Yeah, when I tried their demo I was a bit confused too - it's not that impressive. But their model is really good when it comes to cloning voices from small audio samples. It was discovered by 4chan unfortunately [1]. I have only seen a few clips but all of them were racist, sexist or worse. Not appropriate to link them here, I guess. You can see an official sample on their YouTube channel [2]. However, the voices and conversations I've heard yesterday, other than being disgusting, were high quality, believable and full of emotions. The voices of Obi Wan Kenobi or Joe Biden sounded so genuine that it was creepy. I know there has been tools to deepfake voices for years now, but this is the first time I'm seeing one that sounds so authentic. [1]: https://www.theverge.com/2023/1/31/23579289/ai-voice-clone-deepfake-abuse-4chan-elevenlabs https://www.theverge.com/2023/1/31/23579289/ai-voice-clone-d... [2]: https://www.youtube.com/watch?v=17_xLsqny9E https://www.youtube.com/watch?v=17_xLsqny9E