3 ms·
There is a real possibility that local, free models keep trailing a few years behind the frontier. If that does happen, then the math for building out all this
by qgin 1y ago
There is a real possibility that local, free models keep trailing a few years behind the frontier. If that does happen, then the math for building out all this capacity is that you need to make a profit in that window. Can they recoup a trillion dollar data center capex in 2-3 years?
- onion2k 1y agoDoesn't that require local hardware to trail a few years behind as well? I don't see consumer hardware being on the same level as a cluster of A100s for a very long time - mostly due to form factor. No one wants a laptop that's two inches thick and liquid cooled. :)
- qgin 1y agoThat’s true, but models have been getting more efficient over time as well.
- protocolture 1y agoI find the smaller Qwen models and waiting 30 seconds are actually quite tolerable.
- cyberax 1y agoYou can't train new models on consumer hardware.
- protocolture 1y agoRight, so the consumer use of LLMs is really just covering for the commercial training of LLMs. If training slowed down by 2/3rds would consumers be that much worse off?