6 ms·

I don't think GANs are being used to do anything very serious at the moment (I would love to be corrected on this), but they're very exciting in terms of their

I don't think GANs are being used to do anything very serious at the moment (I would love to be corrected on this), but they're very exciting in terms of their capabilities and promise. Some good progress has been made over the last year in making them easier to train and making them so they produce varied outputs

jamesblonde 9y ago
WaveNet2 is using a variant of GANs to produce the most high fidelity speech (text->to->voice) of any computer system out there - in realtime. WaveNet from last year took 50 sec (i think) to generate 1 sec of audio. By using a variant of a GAN to re-engineer WaveNet, they can now produce real-time high quality text-to-voice: https://deepmind.com/documents/131/Distilling_WaveNet.pdf https://deepmind.com/documents/131/Distilling_WaveNet.pdf
- argonaut 9y ago
  WaveNet2 is not a GAN, and describing it as a "variant of GANs" is like calling Python a variant of Java: it's highly misleading (WaveNet2 and GANs are both generative models, Python and Java are both programming languages). Also WaveNet2 makes no improvements in the actual quality of the model, only the run-time performance.
  - chillee 9y ago
    Yep, from the paper: > It is worth noting the parallels to Generative Adversarial Networks (GANs [7]), with the student playing the role of generator, and the teacher playing the role of discriminator. As opposed to GANs, however, the student is not attempting to fool the teacher in an adversarial manner; rather it cooperates by attempting to match the teacher’s probabilities. Furthermore the teacher is held constant, rather than being trained in tandem with the student, and both models yield tractable normalised distributions. WaveNet2's main resemblance to a GAN is that it uses another neural network for the loss function.

6 ms·

I don't think GANs are being used to do anything very serious at the moment (I would love to be corrected on this), but they're very exciting in terms of their

by habitue 9y ago

jamesblonde 9y ago
WaveNet2 is using a variant of GANs to produce the most high fidelity speech (text->to->voice) of any computer system out there - in realtime. WaveNet from last year took 50 sec (i think) to generate 1 sec of audio. By using a variant of a GAN to re-engineer WaveNet, they can now produce real-time high quality text-to-voice: https://deepmind.com/documents/131/Distilling_WaveNet.pdf https://deepmind.com/documents/131/Distilling_WaveNet.pdf
- argonaut 9y ago
  WaveNet2 is not a GAN, and describing it as a "variant of GANs" is like calling Python a variant of Java: it's highly misleading (WaveNet2 and GANs are both generative models, Python and Java are both programming languages). Also WaveNet2 makes no improvements in the actual quality of the model, only the run-time performance.
  - chillee 9y ago
    Yep, from the paper: > It is worth noting the parallels to Generative Adversarial Networks (GANs [7]), with the student playing the role of generator, and the teacher playing the role of discriminator. As opposed to GANs, however, the student is not attempting to fool the teacher in an adversarial manner; rather it cooperates by attempting to match the teacher’s probabilities. Furthermore the teacher is held constant, rather than being trained in tandem with the student, and both models yield tractable normalised distributions. WaveNet2's main resemblance to a GAN is that it uses another neural network for the loss function.