4 ms·
Are people quantizing the activations? I was under the impression that people generally quantize the parameters but leave the activations unchanged.
by sebzim4500 2y ago
Are people quantizing the activations? I was under the impression that people generally quantize the parameters but leave the activations unchanged.
- brrrrrm 2y agoYou can quantize KV caches