5 ms·
I wouldn't. The results they offer are excellent, but the missing points they need to achieve human level are related to producing the correct intonation, which
by espadrine 10y ago
I wouldn't. The results they offer are excellent, but the missing points they need to achieve human level are related to producing the correct intonation, which requires accurate understanding of the material. That is still at least ten years in the future, I expect.
- grandalf 10y agoI don't see why many aspects of intonation couldn't be taught the same way ...
- swsieber 10y agoI think the point is that different parts of the story need different intonation patterns (reading a scary part vs a boring part, etc.). So in theory, it could be achieved by having multiple training sets (for the different intonation styles), along with analysis of the text to direct which part of the text needs what intonation. You might even be able to blend intonations.
- nhaliday 10y agoOr just pay MTurk workers to annotate texts with intonation cues. I kinda doubt that would be profitable relative to just hiring readers, but in general you don't need to replace workers completely to cannibalize some of their wages/jobs.
- CamperBob2 10y agoOr treat it as part of the original author's job. When you write a piece of music you add tempo and intensity metadata to the score, so why not do the same when writing a novel?
- drewler 10y agoOr the author could just add that information to the text. This way there's no need to "understand" it.
- partycoder 10y agoThere is significant advance in sentiment analysis too. Trading bots use sentiment analysis as some of the input for their time series prediction algorithms. I would not say 10 years.
- iandanforth 10y agoWhat about auto-tuning? I can do a pretty good reading-with-intention but I don't have the melt-your-brain-rich tones of Stephen Fry or Ian McKellen.
- syllogism 10y agoNot really. They're training directly on the waveform, so the model can learn intonation. They just need to train on longer samples, and perhaps augment their linguistic representation with some extra discourse analysis. A big problem with generating prosody has always been that our theories of it don't really provide a great prediction of people's behaviours. It's also very expensive to get people to do the prosody annotations accurately, using whatever given theory. Predicting the raw audio directly cuts out this problem. The "theory" of prosody can be left latent, rather than specified explicitly.
- ycombinatorMan 10y agotheres 0 chance of effective intonation and tone without understanding of the material
- Houshalter 10y agoAnd who says it can't understand the material? There have been recurrent networks trained that can translate between languages, or predict the next word in a sentence, at remarkable accuracy. Combined with wavenet this could be quite effective.
- thomasahle 10y agoThere could be cases where the intonation is dependent on things entirely outside of the book. If say a politician does something in the writing that is far from what we would expect them to do in today's world.
- spiritus_ 10y agoLike traditional audio books can capture perfectly what you're referring to...
- ycombinatorMan 10y agoThey can, though?