4 ms·
The ability to convert ASCII text into legible phonemes has always been such a trivial part of a voice actor's job it's the part that is considered "free". Afte
by shalmanese 5y ago
The ability to convert ASCII text into legible phonemes has always been such a trivial part of a voice actor's job it's the part that is considered "free". After all, for decades already, you've been able to go on Mechanical Turk or Fiverr and get someone to do a quite good voice conversion for 1/10th the price of a voice actor and yet that market has remained quite small.
The real skill of a voice actor is to collaborate with the writer on deciding the specific vocal choices to make during a performance to give it specific character and intentionality. There's been no work in this area and, indeed, it's hard to imagine how you would even design a system to annotate text with specific intonation cues that isn't many times slower than just saying the thing out loud.
eg: Imagine you had a WebMD page and you gave it to two different voice actors and you told one to try and make this drug sounds as promising as possible and another to make it sound as scary as possible. One piece of text can produce two vastly different audio products depending on intentionality. But with AI tools, there isn't even a setting for getting different audio from the same text and it's not even clear how you would build the setting that would allow you to convey what intentionality you want from the AI.
In short, there's a market for just handing a raw piece of text over to a human to convert into audio with no other interaction and that market is amenable to be taken over by AI but is already quite cheap and quite a small market. There's an entirely separate market where the voice actor sits down with the author and talks over what the intentions of the text are and how best to convert them to audio and nobody is thinking about building AIs that can understand intentionality any better than a human would.
- mootzville 5y agoThe first two audio clips in the article are the same text with different intentionality, so they have the 'intent' setting figured out already.
- shalmanese 5y agoIntent is not a binary choice, it's an infinite gradation. This isn't about just text-to-voice AI but about how we build AI systems in general. The AI we have now is good for a) problems with an unambiguously correct answer that AIs can perform better than humans (like camera tracking a scene). b) problems where the deficiencies of AI performance are made up for by other characteristics (like machine translation which is often bad but at least its instant) Where we have no real advances in AI are problems in which there are multiple valid answers and how to coach and give feedback to an AI to improve their answer more in accordance to your preferences. People who make pollyannaish predictions about AI takeover fail to understand this distinction. eg: It's relatively easy to make an AI that can spit out a bunch of brand new recipes. But we don't know how to right now take an 85% good recipe that an AI generates, make it, taste it and then give AI feedback that would allow it to improve that recipe. Like, we don't even know the UI for that. About the best UI we have for it right now is to have the AI show you two versions side by side and you pick the better one until it gradient descents into what you want but that's unbelievably clunky for most tasks. Where humans excel is at the interface and the interface makes up a surprisingly large part of many tasks, especially ones that white collar workers mistakenly regard as "menial".