4 ms·
Wow. I doubt Anthropic can raise that. Are they more efficient, can they do with less?
by brcmthrowaway 7mo ago
Wow. I doubt Anthropic can raise that. Are they more efficient, can they do with less?
- strongpigeon 7mo agoGiven how all of Big Tech (except Google obviously) is going all in on Claude Code, I wouldn't be surprised if Anthropic becomes profitable first.
- rvz 7mo agoAnthropic doesn't have anything else other than the Claude models. But notice that no-one, not a single mention of Deepseek tells me that they are preparing to scare everyone again. Which is why Dario continues to scare-monger on local models. Sometimes you do not need hundreds of billions of dollars for inference when it can be done locally with efficient software; and Google proved that. But where is the money in that? So continues the flawed belief in infinitely buying GPUs to scale which Nvidia needs you to do. Only a matter of time for local models to reach Opus level. We are 1 or at most 2 years behind that and Anthropic knows that.
- randomNumber7 7mo agoLocal models just make no economic sense since the GPU will idle 99% of the time.
- twoodfin 7mo ago[dead]
- zozbot234 7mo agoYou have a GPU already (at least an iGPU and an NPU on most newer platforms) as part of your computer, might as well get some use out of it with local inference. And trying to do inference on a larger model with an undersized GPU will have you idling a lot less than 99% - but that still makes a lot of sense for most casual users who will only rarely need a genuine "Pro" class answer from AI. Doing that locally is way less hassle than paying for a subscription or messing with API spend.
- amazingamazing 7mo agoFalse on a team that’s distributed
- p12tic 7mo ago> Only a matter of time for local models to reach Opus level. We are 1 or at most 2 years behind that and Anthropic knows that. Can confirm. Kimi K2.5 is pretty intelligent and most of the time there's no difference between Opus and Kimi.