3 ms·
Are there any quantized versions yet? https://huggingface.co/s3nh/Open-Orca-Mistral-7B-OpenOrca-GGUF/discussions https://huggingface.co/s3nh/Open-Orca-Mistral-7
by brianjking 3y ago
Are there any quantized versions yet? https://huggingface.co/s3nh/Open-Orca-Mistral-7B-OpenOrca-GGUF/discussions https://huggingface.co/s3nh/Open-Orca-Mistral-7B-OpenOrca-GG... doesn't seem to have any weights uploaded.
Secondly, is this instruction tuned?
- SushiHippie 3y agoGGUF: https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF GPTQ: https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GPTQ https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GPTQ AWQ: https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-AWQ https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-AWQ Thebloke is really really fast, he quantized and uploaded them already yesterday.