4 ms·
llama.cpp can quantize a model for you: https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#quantization https://github.com/ggerganov/llama.cpp?tab=readm
by pja 2y ago
llama.cpp can quantize a model for you:
https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#quantization https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#qu...
- wkat4242 2y agoThanks!!