4 ms·
You can download LM Studio today and try it out. I've had success with the Mistral Small Instruct IQ3M model, which fits in VRAM.
by rubatuga 2y ago
You can download LM Studio today and try it out. I've had success with the Mistral Small Instruct IQ3M model, which fits in VRAM.