3 ms·
They are different quantization types, you can read more here https://huggingface.co/docs/hub/gguf#quantization-types https://huggingface.co/docs/hub/gguf#quant
by huydotnet 6mo ago
They are different quantization types, you can read more here https://huggingface.co/docs/hub/gguf#quantization-types https://huggingface.co/docs/hub/gguf#quantization-types