13 ms·
Claude Opus 4.1
- jasonlernerman 1y agoHas anyone tested it yet? How's it acting?
- smerrill25 1y agowaiting for this, too.
- usaar333 1y agoNo obvious gains I feel from quick chats, but too early to tell. These benchmark gains aren't that high, so I doubt it is that obvious.
- jedisct1 1y agoTested it on a refactor of Zig code. It worked fine, but was very slow.
- minimaxir 1y agoThis likely won't move the needle for Opus use over Sonnet while the cost remains the same. Using OpenRouter rankings (https://openrouter.ai/rankings https://openrouter.ai/rankings) as a proxy, Sonnet 3.7 and Sonnet 4 combined generates 17x more tokens than Opus 4.
- qsort 1y agoAll three major labs released something within hours of each other. This anime arc is insane.
- deleted 1y ago[deleted]
- x187463 1y agoGiven the GPT5 rumors, August is just getting started.
- kridsdale3 1y agoGiven the Gregorian Calendar and the planet's path through its orbit, August is just getting started.
- tomrod 1y agoThis legitimately made me chuckle.
- wunderg 1y agoGood one, made my day
- aitchnyu 1y agoNo, the rotation of the Earth around its axis did so.
- Onewildgamer 1y agoTechnically, it Earth's rotation gives us day and night. Doesn't move the calendar, which is through Earth's orbital revolution
- selcuka 1y agoExactly the GP's point (the rotation of the Earth "made their day").
- rkuykendall-com 1y agohttps://tintin.dlazaro.ca/month https://tintin.dlazaro.ca/month
- MollyRealized 1y agoGiven the majesty and nobility of HN commenters, augustness is just getting started.
- teaearlgraycold 1y ago
- ozgung 1y agoWhat a time to be alive
- tonyhart7 1y agoas if they wait competitor first then launch it at the same time to make market decide which one is best
- torginus 1y agoI think this means that GPT5 is better - you can't launch a worse model after the competitor supersedes you - you have to show that you're in the lead even if its just for a day.
- rapind 1y agoNot sure that this is true. Are there a lot of people waiting anxiously to adopt the next model on the day of release and expecting some huge work advantage?
- azan_ 1y agoAbsolutely.
- dnh44 1y agoIf you’re using an LLM near the limits of what it can do then a small improvement in performance is noticeable.
- rzz3 1y agoMy coworkers/partners and I haven’t stopped talking about it for weeks. I’m one of them I guess, but we’ll see. The ARC graph I saw, if accurate, is really incredible.
- vFunct 1y agoNone of them seem to have published any papers associated with them on how these new models advanced the state-of-the-art though. =^(
- hugodan 1y agochina will do that for them
- candiddevmike 1y agoIt's definitely a coincidence
- wilg 1y agoIt's not a coincidence or a cartel, it's PR counterprogramming.
- BudaDude 1y agoAgree 100% If you look at the past, whenever Google announces something major, OpenAI almost always releases something as well. People forget realize that OpenAI was started to compete with Google on AI.
- brookst 1y agoAny source or just vibes? In my experience it take weeks if not months to coordinate a release, from testing to documentation to drafting press releases in multiple languages to benchmarks and website updates. I’m old and I’ve been in this industry most of my life. I have never once seen or heard of all of that work being done and the company just waiting on competitors before pulling the trigger.
- subarctic 1y agoBut is it just a coincidence
- Etheryte 1y agoThis is why you have PR departments. Being on top of the HN front page, news sites, etc matters a lot. Even if you can't be the first, it's important to dilute the attention as much as possible to reduce the limelight your competitors get.
- paulryanrogers 1y ago"Prep the next three point releases now, but don't release any until I say so. None needs to be noticably better or even different, just has to have a higher number." -CEO of AI companies
- andai 1y agoHow do they know when it's time? Corporate espionage? Or do they just have Next Thing queued up months in advance and ready to go.
- j45 1y agoThey likely sit on releases ready to go.
- qoez 1y agoThere's so many leakers in every lab
- PeterStuer 1y agoEu auto brands colluded for years to synchronize new tech into their model lines. Could it be the AI SaaS sector is showing its first steps towards "maturity"? /s
- steveklabnik 1y agoThis is the bit I'm most interested in: > We plan to release substantially larger improvements to our models in the coming weeks.
- machiaweliczny 1y agoThis is so people don't immediately migrate for GPT5
- deleted 1y ago[deleted]
- NitpickLawyer 1y agoCheekily announcing during oAI's oss model launch :D
- deleted 1y ago[deleted]
- haaz 1y agoit is barely an improvement according to their own benchmarks. not saying thats a bad thing, but not enough for anybody to notice any difference
- waynenilsen 1y agoi think its probably mostly vibes but that still counts, this is not in the charts > Windsurf reports Opus 4.1 delivers a one standard deviation improvement over Opus 4 on their junior developer benchmark, showing roughly the same performance leap as the jump from Sonnet 3.7 to Sonnet 4.
- esafak 1y agoThat is a big improvement.
- ttoinou 1y agoThat's why they named it 4.1 and not 4.5
- zamadatix 1y agoWhen it's "that's why they incremented the version by a tenth instead of a half" you know things have really started to slow for the large models.
- phonon 1y agoOpus 4 came out 10 weeks ago. So this is basically one new training run improvement.
- zamadatix 1y agoAnd in 52 weeks we've gone 3.5->4.1 with this training improvement, meanwhile the 52 weeks prior to that were Claude -> Claude 3. The absolute jumps per version delta also used to be larger. I.e. it seems we don't get much more than new training run levels of improvement anymore. Which is better than nothing, but a shame compared to the early scaling.
- jzig 1y agoI'm confused by how Opus is presented to be superior in nearly every way for coding purposes yet the general consensus and my own experience seem to be that Sonnet is much much better. Has anyone switched to entirely using Opus from Sonnet? Or maybe switching to Opus for certain things while using Sonnet for others?
- datameta 1y agoI now eagerly await Sonnet 4.1, only because of this release.
- rtfeldman 1y agoYes, Opus is very noticeably better at programming in both Rust and Zig in my experience. I wish it were cheaper!
- MostlyStable 1y agoOpus seems better to me on long tasks that require iterative problem solving and keeping track of the context of what we have already tried. I usually switch to it for any kind of complicated troubleshooting etc. I stick with Sonnet for most things because it's generally good enough and I hit my token limits with it far less often.
- unshavedyak 1y agoSame. I'm on the $200 plan and I find Opus "better", but Sonnet is more straight forward. Sonnet is, to me, a "don't let it think" model. It does great if you give it concrete and small goals. Anything vague or broad and it starts thinking and it's a problem. Opus gives you a bit more rope to hang yourself with imo. Yes, it "thinks" slightly better, but still not good enough to me. But it can be good enough to convince you that it can do the job.. so i dunno, i almost dislike it in this regard. I find Sonnet just easier to predict in this regard. Could i use Opus like i do Sonnet? Yes definitely, and generally i do. But then i don't really see much difference since i'm hand-holding so much.
- adastra22 1y agoEvery time that Sonnet is acting like it has brain damage (which is once or twice a day), I switch to Opus and it seems to sort things out pretty fast. This is unscientific anicdata though, and it could just be that switching models (any model) would have worked.
- paxys 1y agoWhy is everything releasing today?
- datameta 1y agoCould it be nobody wanted to be first and overshadowed, nor the only one left out - and it cascaded after the first announcement? My first hunch, though, was that it had been agreed upon. Game theory I think tells us that releasing same day in the pattern ABC BCA CAB etc would be lowest risk and highest average gain?
- highfrequency 1y agoIf they release before GPT-5, they don't have to compare to GPT-5 in their benchmarks. It's a big PR win to be able to plausibly claim that your model is the best coding model at the time of release.
- gusmally 1y agoThey restarted Claude Plays Pokemon with the new model: https://www.twitch.tv/claudeplayspokemon https://www.twitch.tv/claudeplayspokemon (He had been stuck in the Team Rocket hideout (I believe) for weeks)
- Lionga 1y agoThe finest of AI, probably using electricity/water for 100s of homes can not even beat a very simple children game with millions of texts guides etc. about it. When can we replace doctors with it?
- alrocar 1y agojust ran the LLM to SQL benchmark over opus-4.1 and it didn't top previous version :thinking: => https://llm-benchmark.tinybird.live/ https://llm-benchmark.tinybird.live/
- epolanski 1y agoHow does running it multiple times performs? LLMs are non-deterministic, I think benchmarks should be more about averages of N runs, rather than single shot experiments.
- jedisct1 1y agoIs it just me or is it super slow?
- taormina 1y agoAlright, well, Opus 4.1 seems exactly as useless as Opus 4 was, but it's probably eating my tokens faster. Wish they let you tell somehow. At least Sonnet 4 is still usable, but I'll be honest, it's been producing worse and worse slob all day. I've basically wasted the morning on Claude Code when I should've just been doing it all myself.
- AlecSchueler 1y agoI've also noticed Sonnet starting to degrade. It's developing some of the behaviours that put me off the competition in the first place. Needless explanations, filler in responses, wanting to put everything in lists, even increased sycophancy.
- ACCount36 1y agoMajor AI companies are not doing nearly enough to address the sycophancy problem. I get that it's not an easy problem to solve, but how is Anthropic supposed to solve the actual alignment problem if they can't even stop their production LLMs from glazing the user all the time? And OpenAI is somehow even worse.
- bavell 1y ago> I've basically wasted the morning on Claude Code when I should've just been doing it all myself. Welcome to the machine https://www.youtube.com/watch?v=tBvAxSx0nAM&t=45s https://www.youtube.com/watch?v=tBvAxSx0nAM&t=45s
- Aeolun 1y agoI feel like this is just related to my projects getting bigger. Claude Code is trying to keep up with my project evolving from 2k lines of code to 100k lines. Of course it’s going to feel worse.
- taormina 1y agoMy project is basically the same size as when I started using it.
- rvz 1y agoNotice how Anthropic has never open sourced any of their models. This makes them (Anthropic) worse than OpenAI in terms of openness. Since in this case as we all know. [0] "What will permanently change everything is open source and transparent AI models that are smaller and more powerful than GPT-3 or even GPT-4." [0] https://news.ycombinator.com/item?id=34865626 https://news.ycombinator.com/item?id=34865626
- jjani 1y agoOn the other hand, they have always exposed their raw chain of thought, so you know exactly what you're paying for, unlike OpenAI who hides it. Similarly they allow an actual thinking budget rather than vague "low, medium, high", again unlike OpenAI. They also allow API access to all their models without draconic send-us-your-personal-data-KYC, once more unlikely OpenAI. They might not fit your personal definition of "openness", but they do fit many other equally valid interpretations of that contept.
- rvz 1y agoThey better do it sooner then.
- ryandrake 1y agoAm I the only one super confused about how to even get started trying out this stuff? Just so I wouldn't be "that critic who doesn't try the stuff he criticizes," I tried GitHub Copilot and was kind of not very impressed. Someone on HN told me Copilot sucks, use Claude. But I have no idea what the right way to do it is because there are so many paths to choose. Let's see: we have Claude Code vs. Claude the API vs. Claude the website, and they're totally different from each other? One is command line, one integrates into your IDE (which IDE?) and one is just browser based, I guess. Then you have the different pricing plans, Free, Pro, and Max? But then there's also Claude Team and Claude Enterprise? These are monthly plans that only work with Claude the Website, but Claude Code is per-request? Or is it Claude API that's per-request? I have no idea. Then you have the models: Claude Opus and Claude Sonnet, with various version numbers for each?? Then there's Cline and Cursor and GOOD GRIEF! I just want to putz around with something in VSCode for a few hours!
- fuckyah 1y ago[dead]
- deleted 1y ago[deleted]
- adamors 1y agoDownload Cursor and try it through that, IMO that's currently the most polished experience especially since you can change models on the fly. For more advanced usecases, CLI is better but for getting your feet wet I think Cursor is the best choice.
- ryandrake 1y agoThanks. Too bad you need to switch editors to go that path. I assume the Cursor monthly plans are not the same as the Claude monthly plans and you can't use one for the other if you want to experiment...
- kingnothing 1y ago
- ramesh31 1y agoWill the price for 4 go down? I still find Opus completely unusable for the cost/performance, as someone who spends thousands per month on tokens. There's really no noticeable difference from Sonnet, at nearly 10x the price.
- _vaporwave_ 1y agoIt's interesting that Anthropic maintains current prices for prior state of the art models when doing a new release. Why offer a model with worse performance for the same price? What incentives are they trying to create?
- deleted 1y ago[deleted]
- dysoco 1y agoI'm guessing it's mostly for legacy reasons. When 3.7 came out many people were not happy with it and went back to 3.5; I guess supporting older models for a while makes sense.
- gwd 1y ago> What incentives are they trying to create? One obvious explanation is that pricing is strongly related to the price to them, and that their only incentive is for people to use an expensive model of they really need it. I forget which one of the GPT models was better, faster, and cheaper than the previous model. The incentive there is obviously, "If you want to use the old model for whatever reason, fine, but we really want you to use the new one because costs us less to run."
- mrcwinn 1y agoo3 and o3-pro are just so good. Sonnet goes off the deep end too often and Opus, in my experience, is not as strong at reasoning compared to OpenAI, despite the higher costs. Rarely do we see a worse, more expensive product win - but competition is good and I’m rooting for Anthropic nonetheless!
- AlecSchueler 1y agoOff the deep end?
- UncleEntity 1y agoProbably referring to it's tendency to over-complicate things to the point you have to step in and be like "WTF are you even talking about... Wouldn't it be a lot simpler to just use the original, well planned out design?" Which it does a lot...
- derwiki 1y agoIt picks a bad path forward and keeps doubling down on it
- WXLCKNO 1y agoo3 feels pretty good to me as well but o3-pro has consistently one shotted problems other LLMs got stuck on. I'm talking multiple tries of claude 4 opus, Gemini 2.5 pro, o3 etc resulting in sometimes hundreds of lines of code. Versus o3-pro (very slowly) analyzing and then fixing something that seemed completely unrelated in a one or two line change and truly fixing the root cause. o3-pro level LLMs at reduced cost and increased speed will already be amazing..
- bayesianbot 1y agoOpenAI also has Flex processing[1] for o3. I've spent most of my time with Gemini 2.5, but lately been trying out a ton of o3 as it seems to work quite well and I get really cheap tokens (~95% of my agentic tokens are cached which is 75% discount and flex mode adds 50% for $0.25 / million input tokens) [1] https://platform.openai.com/docs/guides/flex-processing?api-mode=responses https://platform.openai.com/docs/guides/flex-processing?api-...
- thoop 1y agoThe article says "We plan to release substantially larger improvements to our models in the coming weeks." Sonnet 4 has definitely been the best model for our product's use case, but I'd be interested in trying Haiku 4 (or 4.1?) just due to the cost savings. I'm surprised Anthropic hasn't mentioned anything about Haiku 4 yet since they released the other models.
- mocmoc 1y agoTheir limits are just … a real road blocker
- bananapub 1y agohuh? Claude Mad is tens of hours of opus a month, or you can pay per token and have unlimited. Or did you mean “I wish it was cheaper”?
- andyferris 1y agoHa - the $200 plan should be renamed to "Claude Mad Max" :)
- OldGreenYodaGPT 1y agoClaude Code has honestly made me at least 10x more productive. I’ve burned through about 3 billion tokens and have been consistently merging 5+ PRs a day, tackling tons of tech debt, improving GitHub Actions, and making crazy progress on product work
- totaa 1y agocan you share your workflow?
- steinvakt2 1y agoI also have this feeling that I'm 2-10x more productive. But isn't it curious how a lot of devs feel this way, but no devs that I know have the experience that any of their colleagues have become 2-10x more productive?
- nevertoolate 1y ago10x means to me that i can finish a month of work in max 2 days and go cloud watching. What does it mean for you?
- ares623 1y agoA 60 minute script becomes 6 minutes
- NitpickLawyer 1y agoSometimes 10x can mean that I start things that I would have never started before, knowing it would take a long time. Or that I can have any of the agentic stuff "explore" libs, stacks and frameworks I wanted to look at, but had no time. Or distill some vague docs and blog posts to find common use cases for tech x. And so on. It's not always a literal 10x time for taskA w/ AI vs taskA w/o AI...
- mwigdahl 1y ago<raises hand> Our automated test folks were chronically behind, struggling to keep up with feature development. I got the two assigned to the team that was the most behind set up with Claude Code. Six weeks later they are fully caught up, expanding coverage, and integrating AI code review into our build pipeline. It's not 10x, but those guys do seem like they've hit somewhere around 2x improvement overall.
- P24L 1y agoThe improved Opus isn’t about achieving significantly better peak performance for me. It’s not about pushing the high end of the spectrum. Instead, it’s about consistently delivering better average results - structuring outputs more effectively, self-correcting mistakes more reliably, and becoming a trustworthy workhorse for everyday tasks.
- djha-skin 1y agoOpus 4(.1) is so expensive[1]. Even Sonnet[2] costs me $5 per hour (basically) using OpenRouter + Codename Goose[3]. The crazy thing is Sonnet 3.5 costs the same thing[4] right now. Gemini Flash is more reasonable[5], but always seems to make the wrong decisions in the end, spinning in circles. OpenAI is better, but still falls short of Claude's performance. Claude also gives back 400's from its API if you CTRL-C in the middle though, so that's annoying. Economics is important. Best bang for the buck seems to be OpenAI ChatGPT 4.1 mini[6]. Does a decent job, doesn't flood my context window with useless tokens like Claude does, API works every time. Gets me out of bad spots. Can get confused, but I've been able to muddle through with it. 1: https://openrouter.ai/anthropic/claude-opus-4.1 https://openrouter.ai/anthropic/claude-opus-4.1 2: https://openrouter.ai/anthropic/claude-sonnet-4 https://openrouter.ai/anthropic/claude-sonnet-4 3: https://block.github.io/goose/ https://block.github.io/goose/ 4: https://openrouter.ai/anthropic/claude-3.5-sonnet https://openrouter.ai/anthropic/claude-3.5-sonnet 5: https://openrouter.ai/google/gemini-2.5-flash https://openrouter.ai/google/gemini-2.5-flash 6: https://openrouter.ai/openai/gpt-4.1-mini https://openrouter.ai/openai/gpt-4.1-mini
- Aeolun 1y agoIn every price comparison I make. Claude (API) always comes out cheapest if you manage to keep most of your context cached. 90% price reduction for input is crazy.
- cma 1y agoCached prices: $.31 for Gemini Pro / Mtok, $1.50 for claude opus 4.1 / Mtok There's additional storage costs with google caching, around $3.75 for 5 minutes/Mtok, and Claude Opus is $3.75 for 5minute Cache Writes / Mtok. For cached reads Gemini Pro is 5X cheaper than Opus and like $0.01 more than Sonnet.
- generalizations 1y agoGet a subscription and use claude code - that's how you get actual reasonable economics out of it. I use claude code all day on the max subscription and maybe twice in the last two weeks have I actually hit usage limits.
- paul7986 1y agoClaude plus failed me today badly compared to chatGPT plus. I uploaded a web design of mine (jpeg) and asked Claude to create the html/css. Asked GPT to do the same. GPT's code looked the closet to the design I created and uploaded. Just five to ten small tweaks and I was done vs. Claude it would have taken me almost triple the steps. I actually subscribed to both today (resubscribed to GPT) and going to keep testing which one is the better front-end developer (i am, but got to embrace AI ).
- alvis 1y agoFunny Open AI and Anthropic seems to be coordinating their releases on the same day
- KaoruAoiShiho 1y agoFor me this is the big news of the day. Looks insane.
- hartator 1y ago> 1 min read What the point of these? Kind of interesting that we live in an area of AI super advanced, but still make basic UI/UX mistake. The tagline of this blog post shouldn't be "1 min read". It's not even accurate. I timed myself not reading fast but not slow, took me 3 min 30s. Maybe the images need be OCRed to make the estimation more accurate.
- TimMeade 1y agoThis has been the worse Claude day ever. Just fell apart. Not sure if the release is why, but cursing in documents and can not fix a bug after hours of back and forth.
- octo888 1y agoYou're prompting it wrong !
- system2 1y agoClaude lost me after I used it for a day. Their pricing model is bonkers. There is no way any developer in their right mind would go with Claude.
- thirdacc 1y agoTheir API pricing is bonkers, their subscription is a great deal for what you get
- deleted 1y ago[deleted]
- sneak 1y agoIs it just me, or is Opus 4.1 substantially worse in Claude Code than Opus 4.0 was? I feel like I'm using Sonnet. It's making really stupid errors and I have to work three times as much to get the same results as last week.
- cailai 1y ago[dead]
- tecleandor 1y agoIs there any tool like Claude Code that can go into the same "automatic feedback and coding loop" (I don't know if it has an official name) but compatible with using different LLMs. I've used Aider for a while, and I kind of liked if, but it felt like it needed way more manual work, and I also want to use different models, probably locally hosted. Haven't used Aider in 2 or 3 months, so I don't know if it already has evolved in that way... edit: in the other hand, the automatic feedback loop means it sometimes go very crazy and the API costs skyrocket easily. But maybe that's another reason to run it locally.
- bananapub 1y agoopencode, but note that all the self-hosted llms are much worse at coding than claude code with opus/sonnet. there's also claude-code-proxy to make claude code use other models.
- ptrrrrrrppr 1y agoClaude code proxy technically works with openai but tool use breaks every now and then on o3-mini, making it unusable for me
- mitemte 1y agoClaude Code Router (https://github.com/musistudio/claude-code-router https://github.com/musistudio/claude-code-router) lets you use Claude Code with other, non-Anthropic models.
- taoh 1y agoHave been using it in Claude Code with Max Plan for one day. The rate of acceptance is noticeably higher.
- camillomiller 1y agoWell wait another 24hrs…
- sbene970 1y agoOpus 4.1 is now set as default model in Claude Code - just a heads-up.
- drewbitt 1y agoNot for me.