32 ms·
> https://github.com/ggerganov/llama.cpp/issues/1602#issuecomment-1570827592 https://github.com/ggerganov/llama.cpp/issues/1602#issuecomm... Here somebody quan
by Kelamir 3y ago
> https://github.com/ggerganov/llama.cpp/issues/1602#issuecomment-1570827592 https://github.com/ggerganov/llama.cpp/issues/1602#issuecomm...
Here somebody quantized it down to 29929.56MB .