7 ms·
Agreed but I want to see how it plays out. Historically a good Windows computer cost $1000 and it was all it took to start programming. How much does it cost a
by pmontra 4mo ago
Agreed but I want to see how it plays out. Historically a good Windows computer cost $1000 and it was all it took to start programming. How much does it cost a computer with enough resources to run a good enough AI model for agentic workflows and a reasonable time to first token? Can "most of the world" afford buying one?
- bensyverson 4mo agoYes, between Moore's Law and more efficient model architectures, we just have to let time do its work.
- Danox 4mo agoSoftware models and hardware are getting better all the time—and that’s where some big companies spending billions might stumble! In fact, Microsoft recently announced that they’re scaling back a bit on their AI investments.
- ktallett 4mo agoHence why brute force needs to be replaced with examples such as neuromorphic methods. It could realistically could be combined with mesh networking as well to utilise the capabilities of all computers locally.
- mbgerring 4mo agoAbout $2k in 2026 dollars and falling.
- simonw 4mo ago... or rising, at least as long as there's a RAM shortage.
- mbgerring 4mo agoI’d bet that there won’t be a RAM shortage for very long.
- simonw 4mo agoThe best article I've seen about that is this one by David Oks (ignore the headline, the content is much better): https://davidoks.blog/p/ai-is-killing-the-cheap-smartphone https://davidoks.blog/p/ai-is-killing-the-cheap-smartphone > It was only in 2025, as memory prices began an unprecedented surge, that the memory makers started to build new fabs targeted at HBM, all slated to start producing chips in 2027 or 2028.
- fellowmartian 4mo agoIt still won’t help unless the AI bubble pops. Even old fabs will continue pumping out HBM instead of DRAM as long as hyperscalers gobble it up.
- Avicebron 4mo agoThis seems wildly optimistic, do you have anything to support it?
- AnimalMuppet 4mo agoHistory? This isn't the first RAM shortage. When one happens, producers build more fabs. The fabs come online, the availability of memory shoots up, and the shortage goes away, usually replaced by a glut. If you want to argue that this is different from all previous RAM shortages, you can, but the burden of proof is on you to show the difference.
- nok22kon 4mo agothere is a glut if demand stops. this time demand doesn't stop. there is an exponential demand for tokens.
- Kim_Bruning 4mo agoRoughly about Eur 3-4K right this minute I think? The graphics card, ram and storage are punishing. Under more normal circumstances (hopefully late 2027) it'd be 1500-2500 depending on what you think is realistically useful. Possibly it's the same price range, allowing for inflation.
- wizee 4mo agoQwen 3.6 27B is quite good for agentic coding, and practical to run on consumer hardware. You need a system with either 32+ GB VRAM, or a unified memory system with 48+ GB VRAM and a decent integrated GPU. While not cheap, such a setup is still attainable for much of the world, and will eventually get cheaper over time. Open models hosted on non-American clouds also remain an option with a much lower barrier to entry, for cases where privacy is less critical.
- jochem9 4mo agoThere was an article on HN a few weeks ago where someone detailed how they managed to get an old datacenter GPU to run in their consumer PC, getting decent performance with qwen. He spent something like $200 on the GPU (second hand of course). So yeah, I think models on local hardware will be quite common soon among the tech savvy (such as people creating software).
- wrs 4mo agoEspecially considering the millions of 2026-class data center GPUs that massively overinvested companies are currently buying, which will be obsolete in a few years.
- robwwilliams 4mo agoI think you are right when you factor in the much more efficient newer high end GPU. That is what may make the current GPu investments obsolete in 2-4 years.
- treis 4mo agoI think those are going to be run until they die. The capex vs opex is too high to obsolete them in a few years. They'll keep serving current gen LLMs for as long as they keep running.
- Chu4eeno 4mo agoThey can also be used for other things than running the main frontier whatever model as well. E.g. grok isn't truly multi-modal, it has a callable tool that is a separate VLM it invokes on image URLs or files (for a long time it was grok-1.5v, but I think they have upgraded now, it was pretty bad). And then you have the small summarizer models for the CoT/thought traces, the guidable summarizer models for the standard browse tools, etc. There's a ton of stuff that can use an aging GPU.
- Chu4eeno 4mo agoOpen weights/source doesn't necessarily mean running on local hardware, though. I imagine having multiple providers competing will drive down hosted versions of open weight models drastically.
- Tuna-Fish 4mo agoYou are describing OpenRouter. And yes, it does.
- Chu4eeno 4mo agoWell, open router is a bit more general, since it just proxies requests to both proprietary and open weights models. I was thinking more of the providers of inference on open weight models that openrouter proxies to.
- mncharity 4mo ago> Open weights/source doesn't necessarily mean running on local hardware, though. And we've barely started to scratch the surface on helping open-weight models "be the best they can be", with cloud burst parallel sampling and prompt mutation. Looking for best probabilistic results for a prompt, and looking for best prompt variants for a task. Adaptively scaling computes at generation, not just training. And speculatively, if agentic coding is naturally a multiplicity, what UX might enable human devs to dance with that quantum superposition? Rather than quickly collapsing to one monkey and its keyboard.
- giancarlostoro 4mo agoBefore the AI "crisis" it used to take about $3500 to get a prebuilt with a 5090 which can run good enough LLMs. I run reasonable LLMs on just 16GB of VRAM on my Mac, and the 5090 has double that.
- dgellow 4mo agoWhat model (and quant) do you run with 16GB? I assume you have a 24GB model, and dedicate 16GB to the model?
- giancarlostoro 4mo agoQuite the opposite, you want something below your max VRAM and you use up to your max VRAM for the context window, so it can run longer. https://huggingface.co/Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled https://huggingface.co/Jackrong/Qwen3.5-27B-Claude-4.6-Opus-...
- dgellow 4mo agoSorry, I meant a 24GB MacBook Pro model, to run a 16GB LLM :) My use of the term model here is confusing
- majormajor 4mo ago> Historically a good Windows computer cost $1000 and it was all it took to start programming. Gotta remember inflation here. $1K in 1995 was roughly equivalent to $2K now and wouldn't have been a particularly "good" machine then. In 1982 the Commodore 64 started at about $600 bucks, also roughly around $2K today. If you outgrew that, beefier machines back then were A LOT. It was easy to find $2k+ towers and (especially) laptops even into the 2000s, and a lot of those would be $5K+ equivalent today.
- SoftTalker 4mo agoAnd a unix workstation in those days could be high 4 or even 5 figures, depending on configuration.
- deleted 4mo ago[deleted]
- rayiner 4mo agoIsn’t this just a bet that I’ll have an AI data center in my iPhone within 10 years? Why is that a bad bet?
- abetusk 4mo agoMoore's law or one of its generalizations still holds, so it will only be a short matter of time before a $1k computer will be able to train and run a powerful enough model.
- Windchaser 4mo agoI thought Moore's Law came to an end in the last decade? Certainly the transistors/chip or transistors/$ or flops/$ have not been progressing at the same exponential rate as during 1970-2010. There is still progress, but it's rather slower.
- abetusk 4mo agoI was careful to say "Moore's law-like". Moore's law is stated as "transistor count per area doubles about every 2 years." [0] As stated, then yes, this might be true but, while important, that's not really the quantity we care about. As you point out it's really cost per transistor or cost per flop that we mostly care about. I'm finding it hard to find a succinct and clear plot, but I believe one is provided by Our World In Data on "GPU computational performance per dollar" [1] which, to my eyes, clearly shows exponential growth in computational power per dollar. The picture for storage is a little more muddied but if you squint just right you might still be able to recover an uninterrupted exponential growth [2]. In my view, it's pretty clear that advances in AI have progressed so quickly because GPUs have been keeping up with the exponential growth of computational power (per unit cost). Exponential growth in this area is usually characterized by "S-curves", where one technology gets saturated but the exponential increase in power or decrease in cost is picked up by another, adjacent, technology, that allows the growth to continue. For compute it's CPUs to GPUs. For storage it's platter drives that are now being overtaken by SSDs. The more general phenomena is called Wright's law, or experience curve effects [3]. [0] https://en.wikipedia.org/wiki/Moore%27s_law https://en.wikipedia.org/wiki/Moore%27s_law [1] https://ourworldindata.org/grapher/gpu-price-performance?yScale=log https://ourworldindata.org/grapher/gpu-price-performance?ySc... [2] https://ourworldindata.org/grapher/historical-cost-of-computer-memory-and-storage https://ourworldindata.org/grapher/historical-cost-of-comput... [3] https://en.wikipedia.org/wiki/Experience_curve_effect https://en.wikipedia.org/wiki/Experience_curve_effect
- crazycracker 4mo agoHistorically the cost of compute has also gone down. Like just look at it as compared to a year ago. We have amazing open source models that can run on consumer hardware and if we go away from our obsession of using opus 4.8 or mythos for everything then it actually is super amazing to see what these open source models could do. I use qwen3.6:27b as a daily driver and I am heavily impressed with it.
- ssivark 4mo agoI don't understand the justification for local hardware with cost as the motivation. The same (or bigger/better) open weights models can served by third parties at much higher resource utilisation, and will therefore be much cheaper!? Especially because the world is likely to persist, at least for a while, in state where computing hardware demand drastically exceeds supply resulting in high prices for hardware. So why wouldn't you want to max out utilisation and amortize costs, at least for typical (non sensitive) use cases.
- layer8 4mo agoIMO the more useful distinction is in analogy to VPS versus SaaS/PaaS. Open models allow you to use any inference provider you like, including local ones, similar to running open-source software using VPS providers. You’re not bound to a particular SaaS/PaaS as you are with closed model providers. That same freedom also allows you to self-host when you care about that.
- deleted 4mo ago[deleted]
- deleted 4mo ago[deleted]
- skydhash 4mo ago> Historically a good Windows computer cost $1000 and it was all it took to start programming Started with computers around 2009 and later bought an oldish computer (a pentium 4 PC) for the equivalent of 50 usd. Codeblocks and Python Idle were free at the time (C and Python were the first languages I learned). The barrier to programming has always been low as the only thing you needed was books (the internet made things easier) and access to a PC (I had friends with laptop and my school lab).
- Supermancho 4mo agoIn 1998 I had a second PC for the first time in my life. It was an old i486DX2-66 that my dad gave to me. He said it cost him $50 secondhand and was bought so I could put Linux on it.
- epolanski 4mo agoIf we had 256-512 GB ram unified memories at 2022 prices, we'd be talking 1500 computers.
- nicoburns 4mo agoI think AI is still in it's "mainframe era". Once upon a time, computers that ran useful workloads filled a whole room. And now that's true of computers that run (state of the art) AI models. My guess would be that this won't always be the case, although I certainly don't claim to have a clear idea of how things will play out.
- Thraway198 4mo agoWith the free tiers available now you can make your own document processors and other such office software, in one pass.
- orbital-decay 4mo agoHow far back are we talking? Historically there were just a few computers in the world, personal computing revolution happened much later. And a private inference rig costs roughly the same in 2026 as a personal computer did in the early 80's, if you want the performance comparable with a personal workstation of that time (vs a mainframe/supercomputer).
- onel 4mo agoEven if you go with an open source AI model, it will still make a lot more financial sense to pay a provider then actually invest in the hardware to self-host it. It's definitely worth investing in self-hosting the agent infrastructure around the model though: all the documents, knowledge base, all the connectors, the agent itself to run on your hardware