4 ms·
> no one can afford 1200$ a month for llm credits. you'd be surprised....
by bdangubic 6mo ago
> no one can afford 1200$ a month for llm credits.
you'd be surprised....
- 999900000999 6mo agoA Blackwell pro is only 10k. Will Claude constantly be able to deliver more value than rolling your own ? I think the future is a bunch of just good enough models, which is what most people need. Not top of the line models that require millions in hardware to run
- bdangubic 6mo agonot that I disagree with you in principle but I see this the same was a "cloud" - 10's of thousands of companies could save gazillion dollars by hosting their infrastructure and yet they continue to pay insane amounts of moneys to AWSs and Azures and whatnots. While some company's future may as well be running local models I would venture a guess that vast majority will just eat the costs and pass on as much of it as they can to their customers...
- 999900000999 6mo agoHmm, can we agree open models place a sort of price ceiling on what most companies will pay. Eventually another cloud provider can just spin up a few llms vs paying whatever Claude demands