4 ms·
On the one hand, the technology is already there, if you're merely looking for a "mechanical" rendering that sounds like a person with no emotion or understandi
by crazygringo 3y ago
On the one hand, the technology is already there, if you're merely looking for a "mechanical" rendering that sounds like a person with no emotion or understanding of the text -- no meaningful emphases, no meaningful change in rhythm and pitch, etc. (Well and the occasional mispronunciation of a word, especially heteronyms).
But if you're looking for tech that can read it as well as a human can in terms of turning meaning into prosody -- all of the vocal inflections that we use and hear without even realizing it, the things that make it sound human and appropriate to the text -- that's hard to say. (Especially when you consider that most people are bad at audiobook narration, as it's a real skill.)
It might be very soon, if the kind of meaning embedded in LLM's turns out to be perfect for the job. Or it might be very far away, if it turns out that it requires building a kind of accurate model of human emotion and feeling and how that maps to vocal qualities, that has nothing to do with how LLM's work.
- mongol 3y agoApple has already done it: https://www.theguardian.com/technology/2023/jan/04/apple-artificial-intelligence-ai-audiobooks https://www.theguardian.com/technology/2023/jan/04/apple-art...
- crazygringo 3y agoYes, that's exactly the kind of "mechanical" version I was talking about. The article goes on to describe the challenges I was talking about: > Still, computer-generated voices have long struggled to hold the attention of listeners for long periods of time, and to overcome the ‘uncanny valley’ effect of synthetic human speech. Human intonation and inflection are notoriously difficult to predict and replicate.
- deleted 3y ago[deleted]
- burkaman 3y agoSome samples here: https://authors.apple.com/support/4519-digital-narration-audiobooks https://authors.apple.com/support/4519-digital-narration-aud.... It's good, but it would definitely get very monotonous to listen to for 10+ hours, and even in these short cherry-picked examples there are a couple kind of jarring tonal decisions. You'll also notice they avoided sampling any dialogue, presumably because these voices will read all characters in the exact same manner as the narration. I listen to a lot of audiobooks and I definitely notice and get annoyed when I don't like the narrator. I think I could maybe get used to this for one book but I would avoid it if possible, and I would really hate it if every book I listened to used this exact same style. I would say this is probably already good enough for short non-fiction articles, but not there yet for fiction. It is genuinely confusing (for me at least) when an audiobook narrator reads a phrase with the "wrong" emotion, or doesn't vocally distinguish between characters.
- crazygringo 3y agoExactly -- the voices all sound like they belong to somebody emotionally "lobotomized", for lack of a better term. Every sentence has the exact same rhythm patterns, and every sentence that ends with a period ends on the exact same pitch. Listening to a single sentence is fine; listening to just ten sentences is monotonous and just feels strange. It's perfectly fine for Siri responses or reading back a dictated text message. Not for listening to a whole book though.
- TillE 3y agoI've listened to a lot of Books on Tape from the 80s and 90s where narrating in a mostly flat monotone was the norm, but even they would inject emotion and vary their delivery where appropriate. Good modern audiobooks are a true performance even when the narrator isn't doing a bunch of highly distinct voices. You can't replace that with AI any more than you can replace a great voice actor.