4 ms·
I’m imagining a steampunk dystopia in 50 years: “all world production stopped, LLM hosting went down. The market is in free-fall. Sam, are you there?” Man that
by irishcoffee 11mo ago
I’m imagining a steampunk dystopia in 50 years: “all world production stopped, LLM hosting went down. The market is in free-fall. Sam, are you there?”
Man that cracks me up.
- michelsedgh 11mo agoJust like the internet, or Cloudflare going down?
- irishcoffee 11mo agoNo, not even close
- bdangubic 11mo agoit is much worse, I forgot how to push to remote so deploys are delayed :)
- patcon 11mo agoAgreed. When cloudflare (ugh, aka the internet) goes down, we can't access information to think and work through. ("the fuel" in some metaphor) But what about when LLMs go down and a good chunk of a whole generation won't even know how to think, when the remote system goes down? (Is the ability to think "the engine" of self and agency in this metaphor?) We are building a wildly irresponsible context to exist in.
- semi-extrinsic 11mo agoE. M. Forster would like a word.
- teaearlgraycold 11mo agoThe nice thing is unlike Cloudflare or AWS you can actually host good LLMs locally. I see a future where a non-trivial percentage of devs have an expensive workstation that runs all of the AI locally.
- szundi 11mo agoThose good ones are not even close though - or are they
- breatheoften 11mo agoI'm more and more convinced of the importance of this. There is a very interesting thing happening right now where the "llm over promisers" are incentivized to over promise for all the normal reasons -- but ALSO to create the perception that the "next/soon" breakthrough is only going to be applicable when run on huge cloud infra such that running locally is never going to be all that useful ... I tend to think that will prove wildly wrong and that we will very soon arrive at a world where state of art LLM workloads should be expected to be massively more efficiently runnable than they currently are -- to the point of not even being the bottleneck of the workflows that use these components. Additionally these workloads will be viable to run locally on common current_year consumer level hardware ... "llm is about to be general intelligence and sufficient llm can never run locally" is a highly highly temporary state that should soon be falsifiable imo. I don't think the llm part of the "ai computation" will be the perf bottleneck for long.
- lwhi 11mo agoIs there any utility in thinking about LLM provision in terms of the electricity grid? I've often thought that local power generation (via solar or wind) could be (or could have been) a viable alternative to national grid supply.
- tablets 11mo agoI think you're onto something re: electricity - https://www.latitudemedia.com/news/in-africa-the-first-signs-of-solar-adoption-at-scale/ https://www.latitudemedia.com/news/in-africa-the-first-signs...
- exe34 11mo agoI think it's possible, but the current trend is that by the time you can run x level at home, they have 10-100x in the frontier models, so if you can run today's Claude.ai at home, then software engineering as a career is already over.
- lxgr 11mo agoEverybody using the same three centralized inference providers? That would be as absurd and unrealistic as everybody hosting in us-east-1 and behind Cloudflare today!
- _ea1k 11mo agoI remember hearing Karpathy refer to these outages as a worldwide "intelligence brownout". Crazy: https://www.youtube.com/shorts/SV4DMqAJ8RQ https://www.youtube.com/shorts/SV4DMqAJ8RQ
- sergiotapia 11mo agoLike if electricity went out, no? Same deal.
- irishcoffee 11mo agoImagination. “So sorry, we can’t read the WiFi signal from your generator. We don’t know how much to tax you for the emissions. Sadly, we can’t allow it to start.” The story writes itself.
- cdelsolar 11mo agoClaude code cut me off a few days ago and I _seriously_ had no idea what to do. I’ve been coding for 33 years and I suddenly felt like anything I did manually would be an order of magnitude slower than it had to be.
- bdangubic 11mo agoyou can’t say things like this on HN these days :)
- cdelsolar 11mo agolast time (not on here) someone sent me a blog article saying essentially that coding with coding agents is worthless and if you say you've built anything useful with it, that you're _lying_.
- cantalopes 11mo agoYou can always use gemini cli, its pretty good
- prmph 11mo agoNah, I've now resolved to never use it, it'd a total time waster. When it works it's decent, but it does not work like half of time for me.
- deleted 11mo ago[deleted]
- adonovan 11mo ago“A lone coder, trained in the direct manipulation of symbols—an elegant weapon from a more civilized age—-is now all that stands between humanity and darkness.” etc
- PunchyHamster 11mo ago"We vibe coded the problem into existence but now the LLM is down we can't vibe fix it"