4 ms·
Would the not-yet-released M3 Mac Mini with upgraded RAM be enough to do some beginner level LLM work?
by reddit_clone 3y ago
Would the not-yet-released M3 Mac Mini with upgraded RAM be enough to do some beginner level LLM work?
- int_19h 3y agoThose supposedly will go up to 24Gb RAM, which is only enough for inference for ~34b quantized models. At which point you might as well get an RTX 3090 for a PC that you probably already have, and get a better bang for the buck. It also really depends on what you consider "beginner level". Fine-tuning is really easy these days and many people do it, but you really want CUDA for that.