3 ms·
> Perhaps in a few years when both local-running LLMs are good enough on regular consumer hardware there'll be a good reason to upgrade. I mean, local LLMs alr
by ActorNightly 1mo ago
> Perhaps in a few years when both local-running LLMs are good enough on regular consumer hardware there'll be a good reason to upgrade.
I mean, local LLMs already are really good if you own Nvidia Cards, not sure what you are waiting for. 2x3090 will blow any current Mac out of the water in tok/sec
- Insanity 1mo agoI was talking about upgrading to another M-series device. I actually mentioned in the comment that you're replying to that I do run them locally on my desktop. And I run them off of an AMD card, 7900XTX. I'm not sure I'd consider a gaming PC 'regular consumer' hardware especially with today's prices. But yeah, it's definitely doable.