3 ms·
There is, just not for English. Here, take a look at this snippet: https://youtu.be/eEXvMOJ9ps0?t=66 https://youtu.be/eEXvMOJ9ps0?t=66 They play 4 clips, 2 o
by kouteiheika 4y ago
There is, just not for English.
Here, take a look at this snippet:
https://youtu.be/eEXvMOJ9ps0?t=66 https://youtu.be/eEXvMOJ9ps0?t=66
They play 4 clips, 2 of them human, 2 of them AI generated. Can you tell which ones are which?
And the kicker is, this works in real-time (AFAIR), and it doesn't even use the GPU (it's CPU-only), and generates pitch-correct speech (for Japanese). It's not even funny how far ahead they are. And you can buy it right now.
AFAIK they use some sort of a hybrid method with a bunch of custom modeling DSP code around it (they've been doing speech synthesis for over a decade) plus a neural network. One mistake that essentially all of the western TTS models seem to make is that they use only a neural network, without augmenting it with non neural network code, which (from what I can see) is the secret sauce to make a fast and good sounding TTS work.
- orbital-decay 4y agoYes, but can it be used to express emotions? Can it derive emotions from the text alone, without the painstaking guidance? That seems to be the main culprit with existing TTS engines; neutral tone can be generated relatively well.
- vanderZwan 4y agoHonestly I suspect some kind of "emotional markdown" would be more useful if it has a light and intuitive syntax
- com2kid 4y agoHumans can't drive emotions from text alone without external contextual clues. Such has been the source of much miscommunication online. Amateur fiction writing, which tends to overemphasize how things are said ("I guess I can go rescue your cat", the exasperated detective said wearily) might be easier for AI!
- Valgrim 4y agoSure they can, that's the whole point of acting. Also anyone who ever read a story to a kid can infer emotions from the text itself.
- com2kid 4y agoTo a limited extent, sure, but kids books are also written to be very emotive. The linked page actually has examples of the same text being read with different emotions, demonstrating that for even a single sentence a lot of variance is possible.
- burkaman 4y agoI can't, but I don't speak Japanese. Can a fluent Japanese speaker really not tell?