3 ms·
I find it amusing that they're touting it for an application where I find it quite likely that similar NN algorithms will excel at generating speech in someone
by dgacmu 10y ago
I find it amusing that they're touting it for an application where I find it quite likely that similar NN algorithms will excel at generating speech in someone else's voice. (c.f., "neural style transfer" in images, but applied to speech.) We're already getting pretty decent at this for video -- see, for example, https://www.youtube.com/watch?v=ohmajJTcpNk https://www.youtube.com/watch?v=ohmajJTcpNk (Face2Face: Real-time Face Capture and Reenactment)
- dharma1 10y agowas just trying to find papers for that yesterday - neural style for voice/audio. Conceptually it sounds it should be doable, but looking at the actual implementation, I'm not sure it's doable at all with a CNN for audio.
- zopf 10y agoUnsure if it's CNN-based, but check out http://www.wowtune.net/ http://www.wowtune.net/
- dharma1 10y agovery impressive, even if a bit out of tune on the Autumn Leaves demo! They have a very good team with actual audio industry experience. Look forward to seeing more demos. It sounds like a phoneme based speech/singing synthesizer, similar to Yamaha Vocaloid. I wonder how much training data is required to extract the phonemes to create a "voice"