4 ms·
Even if it runs, this will run slowly, and heat up. I think local will always have a place, but the infrastructure is going to be used in my humble opinion.
by noemit 6mo ago
Even if it runs, this will run slowly, and heat up.
I think local will always have a place, but the infrastructure is going to be used in my humble opinion.
- cmiles8 6mo agoToday yes, but between the improved performance of smaller on device models and the hardware itself getting better this issue is short lived.
- plussed_reader 6mo agoI don't want to put information into a black box of mystery that can then be used for other monetization purposes. I am still waiting for a realistic local solution.
- efnx 6mo agoHave you tried qwen3.5 running locally? It’s quite “good enough”.
- throwaway173738 6mo agoCompute evolved from batch systems with time sharing to responsive systems in your pocket. Why wouldn’t that happen here?
- gervwyk 6mo agothere was a time when mainframes was the main thing.. we’ll look back and say data centers was a thing.. (hopefully if we lucky)