18 ms·
What models are you using on LM Studio for what task and with how much memory? I have a 48GB macbook pro and Gemma3 (one of the abliterated ones) fits my non-c
by patates 1y ago
What models are you using on LM Studio for what task and with how much memory?
I have a 48GB macbook pro and Gemma3 (one of the abliterated ones) fits my non-code use case perfectly (generating crime stories which the reader tries to guess the killer).
For code, I still call Google to use Gemini.
- deleted 1y ago[deleted]
- deleted 1y ago[deleted]
- robbru 1y agoI've been using the Google Gemma QAT models in 4B, 12B, and 27B with LM Studio with my M1 Max. https://huggingface.co/lmstudio-community/gemma-3-12B-it-qat-GGUF https://huggingface.co/lmstudio-community/gemma-3-12B-it-qat...
- t1amat 1y agoI would recommend Qwen3 30B A3B for you. The MLX 4bit DWQ quants are fantastic.
- redman25 1y agoQwen is great but for creative writing I think Gemma is a good choice. It has better EQ than Qwen IMO.