3 ms·
Quantization is reducing the precision (and size) of values. https://huggingface.co/docs/optimum/concept_guides/quantization https://huggingface.co/docs/optimu
by dragonwriter 4y ago
Quantization is reducing the precision (and size) of values.
https://huggingface.co/docs/optimum/concept_guides/quantization https://huggingface.co/docs/optimum/concept_guides/quantizat...