3 ms·
And quantised gguf files by Bartowski if somebody wants to download and run through llama.cpp directly https://huggingface.co/bartowski/WizardLM-2-7B-GGUF http
by dimask 2y ago
And quantised gguf files by Bartowski if somebody wants to download and run through llama.cpp directly
https://huggingface.co/bartowski/WizardLM-2-7B-GGUF https://huggingface.co/bartowski/WizardLM-2-7B-GGUF
- xyc 2y agoAlso gguf files by abroxis: https://huggingface.co/ABX-AI/WizardLM-2-7B-GGUF-IQ-Imatrix https://huggingface.co/ABX-AI/WizardLM-2-7B-GGUF-IQ-Imatrix