2 ms·
A bunch have started showing up here: https://huggingface.co/models?other=base_model:quantized:mistralai/Mistral-Small-24B-Instruct-2501 https://huggingface.co/
by simonw 2y ago
A bunch have started showing up here: https://huggingface.co/models?other=base_model:quantized:mistralai/Mistral-Small-24B-Instruct-2501 https://huggingface.co/models?other=base_model:quantized:mis...
The lmstudio-community ones tend to work well in my experience.