3 ms·

If it’s a VAE then the latents should really be distributions, usually represented as the mean and variance of a normal distribution. If so then it should be po

If it’s a VAE then the latents should really be distributions, usually represented as the mean and variance of a normal distribution. If so then it should be possible to use the variance to determine to what precision a particular latent needs to be encoded. Could perhaps help increase the compression further.

nullc 4y ago
Why aren't they scaled to have uniform variances?
- bjornsing 4y ago
  Each image is represented by it’s own distribution over the latents. So the encoder needs the ability to specify some latents very accurately and others more loosely you could say.