3 ms·

I wonder how much better the rendering would be if the audio track were much longer and the software would have more to learn. I don't mean more words for a 1 t

I wonder how much better the rendering would be if the audio track were much longer and the software would have more to learn. I don't mean more words for a 1 to 1 match since it's clearly beyond that (pronouncing words that it didn't see), but voice features that weren't in that short track. Hypothetical question: say it had access to all the episodes from Key & Peele, would the rendering be better to the point you could basically generate an audio track from a script with intonation and all? It would be interesting if they offered "voice packages" either online or offline so you could just pass text through it and the output would be a Morgan Freeman narration. You'd have a shop for "Cords" the same as iTunes for songs & apps. Maybe game developers will find that interesting, too. Having access to way more voices than they'd have in real life, and on a budget. Someone could also save their voices for posterity. Many people listen to recordings of loved ones who passed away to remember them. Saving the voice for new content would be something to think about.

loudmax 10y ago
> It would be interesting if they offered "voice packages" either online or offline so you could just pass text through it and the output would be a Morgan Freeman narration. On that note, should Morgan Freeman be allowed to copyright the sound of his own voice? My immediate inclination is No, you shouldn't be allowed to copyright a voice timbre because it opens up so many weird possibilities for making even more of a mess of copyright law. For example, what happens if two people happen to have the same voice, or at least, close enough so that Adobe's software can't distinguish them. But there is a reasonable case to be made that Morgan Freeman's voice belongs to him. If some company profits from having a reproduction of Morgan Freeman's voice in one of their products, maybe they should pay him.
- thefalcon 10y ago
  Morgan Freeman's likeness - including his voice - is already protected legally, no?
  - bnj 10y ago
    If you're using "audio with substantial similarity" to the voice of Morgan Freeman, but using it to create entirely new works... doesn't that create new and interesting collisions between rights of publicity, fair use, transformative works...?
SamBam 10y ago
One of the things that seems limiting with this version is that, when the words existed (like "wife" and "dogs"), it just seemed to copy-and-paste them around. That honestly sounded pretty bad. But the new words sounded better. I think that if they were using some of the AI-based libraries for generating speech, like WaveNet[1] (hear the samples towards the bottom), and then layered on-top the learning that this algorithm did to get it to sound like the speaker, you'd have a pretty powerful system that would be able to get the intonation right much of the time. And then, of course, when you have the Pro version, you're presumably be able to add additional markup to specify intonation even further. 1. https://deepmind.com/blog/wavenet-generative-model-raw-audio/ https://deepmind.com/blog/wavenet-generative-model-raw-audio...

loudmax 10y ago

> It would be interesting if they offered "voice packages" either online or offline so you could just pass text through it and the output would be a Morgan Freeman narration. On that note, should Morgan Freeman be allowed to copyright the sound of his own voice? My immediate inclination is No, you shouldn't be allowed to copyright a voice timbre because it opens up so many weird possibilities for making even more of a mess of copyright law. For example, what happens if two people happen to have the same voice, or at least, close enough so that Adobe's software can't distinguish them. But there is a reasonable case to be made that Morgan Freeman's voice belongs to him. If some company profits from having a reproduction of Morgan Freeman's voice in one of their products, maybe they should pay him.

thefalcon 10y ago
Morgan Freeman's likeness - including his voice - is already protected legally, no?
- bnj 10y ago
  If you're using "audio with substantial similarity" to the voice of Morgan Freeman, but using it to create entirely new works... doesn't that create new and interesting collisions between rights of publicity, fair use, transformative works...?

SamBam 10y ago

One of the things that seems limiting with this version is that, when the words existed (like "wife" and "dogs"), it just seemed to copy-and-paste them around. That honestly sounded pretty bad. But the new words sounded better. I think that if they were using some of the AI-based libraries for generating speech, like WaveNet[1] (hear the samples towards the bottom), and then layered on-top the learning that this algorithm did to get it to sound like the speaker, you'd have a pretty powerful system that would be able to get the intonation right much of the time. And then, of course, when you have the Pro version, you're presumably be able to add additional markup to specify intonation even further. 1. https://deepmind.com/blog/wavenet-generative-model-raw-audio/ https://deepmind.com/blog/wavenet-generative-model-raw-audio...