GGUF: https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF GPTQ: https://huggingface.co/TheBloke/Mi

GGUF: https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF GPTQ: https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GPTQ https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GPTQ AWQ: https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-AWQ https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-AWQ Thebloke is really really fast, he quantized and uploaded them already yesterday.