5 ms·
> Bafflingly, though, Dessa said that its team created the Rogan replica voice with a text-to-speech deep learning system they developed called RealTalk, which
by rurp 7y ago
> Bafflingly, though, Dessa said that its team created the Rogan replica voice with a text-to-speech deep learning system they developed called RealTalk, which generates life-like speech using only text inputs.
I'm missing something here. How could they replicate the sound of his voice using only text inputs[emphasis theirs]?
- CapmCrackaWaka 7y agoThey probably trained the model with audio, then told it what to say using text inputs. That made me do a double-take at first too, it's a pretty misleading wording.
- tantalor 7y agoThe voice model is trained on voice inputs. The text-to-speech synthesis is based on text only, rather than audio of a different voice. So, together you have voice and text as inputs.
- p1esk 7y agoDo you know if anyone done this without using text? I mean training a model only using voice samples from different people, and using voice input only during inference.
- peteradio 7y agoSounds pretty stupid honestly. There is so much more to voice then the words that are said, and punctuation is just not possible to convey everything. Can their replicate sing? I think not..
- blt 7y agoI think it's pure ignorance on the part of the author, thinking that text-to-speech is somehow harder than speech-to-speech with a voice change.
- scott_s 7y agoI had the same question, and came the conclusion: that's not what they do. In the first post they claim that they used only text inputs [1], but in the post which actually explains what they do [2], they clearly use audio clips to train their model. [1] https://medium.com/dessa-news/real-talk-speech-synthesis-5dd0897eef7f https://medium.com/dessa-news/real-talk-speech-synthesis-5dd... [2] https://medium.com/dessa-news/realtalk-how-it-works-94c1afda62f0 https://medium.com/dessa-news/realtalk-how-it-works-94c1afda...