GGML quantizations are already being uploaded to huggingface, suggesting it works out of the box. GPTQ files are being uploaded too, meaning exLLaMA also might

GGML quantizations are already being uploaded to huggingface, suggesting it works out of the box. GPTQ files are being uploaded too, meaning exLLaMA also might work.