2 ms·
This is only if you ignore the growing open source models. I'm running Qwen3-30B at home and it works great for most of the use cases I have. I think we're goin
by tedivm 1y ago
This is only if you ignore the growing open source models. I'm running Qwen3-30B at home and it works great for most of the use cases I have. I think we're going to find that the optimizations coming from companies out of China are going to continue making local LLMs easier for folks to run.
- DSingularity 1y agoWhat hardware do you use ?
- tedivm 1y agoI have two 3090s, but I'm only using one for this model.