9 ms·
The labs can't just stop improvements though. They made promises. And the capacity to run the current models are subsidized by those promises. If the promise is
by ares623 11mo ago
The labs can't just stop improvements though. They made promises. And the capacity to run the current models are subsidized by those promises. If the promise is broken, then the capacity goes with it.
- wmf 11mo agoMaybe those promises can be better fulfilled with products based on current models.
- selectodude 11mo ago> the capacity goes with it. Sort of. The GPUs exist. Maybe LLM subs can’t pay for electricity plus $50,000 GPUs, but I bet after some people get wiped out, there’s a market there.
- simianparrot 11mo agoDatacenter GPU's have a lifespan of 1-3 years depending on use. So yes they exist, but not for long, unless they go entirely unused. But then they also deprecate in efficiency compared to new hardware extremely fast as well, so their shelf life is severely limited either way.
- soulofmischief 11mo agoAt this pace, it won't be many years before the industry is dependent on resource wars in order to sustain itself.
- nsomaru 11mo agoPersonally I am waiting for the day I can realistically buy a second hand three year old datacentre GPU so I can run Kimi K2 in my shed. Given enough time, not a pipe dream. But 10 years at least.
- tim333 11mo agoYou'll probably be able to run Kimi K2 on the iphone 27.
- Schlagbohrer 11mo agoThis is why I find the business case of putting datacenters in orbit to be so stupid. And yet there are several startups saying they are gonna do just that.
- credit_guy 11mo ago> They made promises. That's not that clear. Contracts are complex and have all sorts of clauses. Media likes to just talk big numbers, but it's much more likely that all those trillions of dollars are contingent on hitting some intermediate milestones.