> but a good reader/voice actor will be able to add emphasis or inflection to enhance the story - and decide to do so based upon the story itself But why do yo

> but a good reader/voice actor will be able to add emphasis or inflection to enhance the story - and decide to do so based upon the story itself But why do you think this AI (VALL-E) isn't doing the same? The training procedure implies that it must follow correct intonation in order to achieve lower test loss. Also, if there is indeed something specific about audiobooks that is harder to replicate, then we can just fine-tune these models on audiobook. Accuracy will jump considerably.