3 ms·
llama.cpp support is here already via https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF And yes it works
by sp332 3y ago
llama.cpp support is here already via https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF And yes it works fine in oobabooga.