Announcing Niva, a radically simple yet capable quantization algorithm. https://github.com/kyegomez/zeta/blob/master/zeta/quant/niva.py https://github.com/kyeg

Announcing Niva, a radically simple yet capable quantization algorithm. https://github.com/kyegomez/zeta/blob/master/zeta/quant/niva.py https://github.com/kyegomez/zeta/blob/master/zeta/quant/niva... Just pass in a model, a weight file, and quantize your model and save 4x in memory and 2x in speed. Get started with zeta now: $pip3 install zetascale