Quantization also works as regularization; it stops the neural network from being able to use arbitrarily complex internal rules. But really it's only really u

Quantization also works as regularization; it stops the neural network from being able to use arbitrarily complex internal rules. But really it's only really useful if you absolutely need to have a discrete embedding space for some sort of downstream usage. VQVAEs can be difficult to get to converge, they have problems stemming from the approximation of the gradient like codebook collapse