2 ms·
They’re really not good enough, unless you consider 64 GB of memory or more consumer grade.
by lxgr 6mo ago
They’re really not good enough, unless you consider 64 GB of memory or more consumer grade.
- steve_adams_86 6mo agoI’m pretty happy with what a 32GB Mac Studio can do for a lot of tasks. They’re the things I’d throw a model like Haiku at, but still genuinely useful. We don’t have an answer to frontier models in the consumer range yet, but we’re not totally trapped. Side note though, it’s the speed that bothers me more than the reasoning. Qwen 3.5 is awesome, but my Claude subscription can tear through similar workloads an order of magnitude faster than my local LLM can when using Haiku. That’ll matter a lot to some people.
- datadrivenangel 6mo agoYeah this is the real killer. slower and more expensive is tough.