3 ms·
Is there a gguf version that could be used with llamafile?
by butz 2y ago
Is there a gguf version that could be used with llamafile?
- simonw 2y agoA bunch have started showing up here: https://huggingface.co/models?other=base_model:quantized:mistralai/Mistral-Small-24B-Instruct-2501 https://huggingface.co/models?other=base_model:quantized:mis... The lmstudio-community ones tend to work well in my experience.