3 ms·
I disagree. In the case of audiobooks, a language model might be able to store context of the story similar to a reader, but a good reader/voice actor will be a
by monkpit 4y ago
I disagree. In the case of audiobooks, a language model might be able to store context of the story similar to a reader, but a good reader/voice actor will be able to add emphasis or inflection to enhance the story - and decide to do so based upon the story itself.
The AI won’t have understanding of the story itself to know what is appropriate or not.
Also, you say only the author could read the story in a certain way. This kind of implies that all audiobook recordings are just 1 long take, with no direction. I am not an expert, but I would assume there’s some creative direction involved.
- rafaelero 4y ago> but a good reader/voice actor will be able to add emphasis or inflection to enhance the story - and decide to do so based upon the story itself But why do you think this AI (VALL-E) isn't doing the same? The training procedure implies that it must follow correct intonation in order to achieve lower test loss. Also, if there is indeed something specific about audiobooks that is harder to replicate, then we can just fine-tune these models on audiobook. Accuracy will jump considerably.
- monkpit 4y agoBecause the intonation can depend on the events of the story, which it can’t be trained on.