4 ms·
I assume this doesn’t yet run on llama.cpp?
by azinman2 3y ago
I assume this doesn’t yet run on llama.cpp?
- tarruda 3y agoIt is based on Mistral which llama.cpp supports, so I assume it does run (you might need to convert to GGUF format and quantize it).
- lhl 3y agohere are some GGUFs https://huggingface.co/brittlewis12/Snorkel-Mistral-PairRM-DPO-GGUF https://huggingface.co/brittlewis12/Snorkel-Mistral-PairRM-D...