https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md#historical-state-of-affairs https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md#... It is (

https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md#historical-state-of-affairs https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md#... It is (IMO) a necessary and good change. I just specified gguf because my 3090 cannot host a 70B model without offloading outside of exLlama's very new ~2 bit quantization. And pre quantized gguf is a much smaller download than raw fp16 for conversion.