3 ms·
Could've been better if GGUF implemented QTIP format. GGUF representation is a major limitation for llama.cpp quantization performance
by om8 11d ago
Could've been better if GGUF implemented QTIP format. GGUF representation is a major limitation for llama.cpp quantization performance
- edflsafoiewq 11d agoThey use their own llama fork anyway, so that shouldn't matter.