17 ms·
GPT-5.3-Codex
- ffitch 8mo ago> our team was blown away > by how much Codex was able > to accelerate its own development they forgot to add “Can’t wait to see what you do with it”
- maheshrijal 8mo agoIt seems Fast!
- minimaxir 8mo agoI remember when AI labs coordinated so they didn't push major announcements on the same day to avoid cannibalizing each other. Now we have AI labs pushing major announcements within 30 minutes.
- crorella 8mo agoThe thrill of competition
- zozbot234 8mo agoThey're also coordinating around Chinese New Year to compete with new releases of the major open/local models.
- DonHopkins 8mo agoYear of the Pelican!
- hoeoek 8mo agosimonw?
- iujasdkjfasf 8mo ago[dead]
- IhateAI 8mo ago[flagged]
- observationist 8mo agoThe labs have fully embraced the cutthroat competition, the arms race has fully shed the civilized facade of beneficient mutual cooperation. Dirty tricks and underhanded tactics will happen - I think Demis isn't savvy in this domain, but might end up stomping out the competition on pure performance. Elon, Sam, and Dario know how to fight ugly and do the nasty political boardroom crap. 26 is gonna be a very dramatic year, lots of cinematic potential for the eventual AI biopics.
- manquer 8mo ago>civilized facade of mutual cooperation >Dirty tricks and underhanded tactics As long the tactics are legal ( i.e. not corporate espionage, bribes etc), the no holds barred full free market competition is the best thing for the market and the consumers.
- thethimble 8mo agoThe consumers are getting huge wins. Model costs continue to collapse while capability improves. Competition is fantastic.
- mrandish 8mo ago> The consumers are getting huge wins. However, the investors currently subsidizing those wins to below cost may be getting huge losses.
- credit_guy 8mo agoYes, but that's the nature of the game, and they know it.
- doom2 8mo ago> Model costs continue to collapse And yet RAM prices are still sky high. Game consoles are getting more expensive, not cheaper, as a result. When will competition benefit those consumers? Or consumers of desktop RAM?
- tedsanders 8mo agoThis goes way back. When OpenAI launched GPT-4 in 2023, both Anthropic and Google lined up counter launches (Claude and Magic Wand) right before OpenAI's standard 10am launch time.
- manquer 8mo agoWouldn't that be illegal ? i.e. cartel to collude like that ?
- avaer 8mo agoYou were downvoted but I don't understand why. This is the purpose/spirit of antitrust law [1] [1] https://en.wikipedia.org/wiki/United_States_antitrust_law https://en.wikipedia.org/wiki/United_States_antitrust_law
- manquer 8mo agoI have long since given up trying to understand voting patterns in HN :) --- Sadly it was the core of anti-trust law, since 1970s things have changed. The predominant view today (i.e. Chicago School view) in both judiciary and executive are influenced by Justice Bork's ideas that consumer benefit being the deciding factor over company's actions. Consumer benefits becomes opinions of projections by either side of a case about the future, whereas company actions like collusion, pricing fixing or M&A are hard facts with strong evidence. Today it is all vibes on how the courts (or executive) feel . So now we have Government sanctioned cartels like in Aviation Alliances [1] that is basically based on convoluted catch-22-esque reasoning because it favors strategic goals even though it would be a violation of the letter/spirit of the law. [1] https://www.transportation.gov/office-policy/aviation-policy/dot-aviation-antitrust-immunity-cases https://www.transportation.gov/office-policy/aviation-policy...
- cedws 8mo agoI wish they’d just stop pretending to care about safety, other than a few researchers at the top they care about safety only as long as they aren’t losing ground to the competition. Game theory guarantees the AI labs will do what it takes to ensure survival. Only regulation can enforce the limits, self policing won’t work when money is involved.
- thethimble 8mo agoAs long as China continues to blitz forward, regulation is a direct path to losing.
- pixl97 8mo agoYou mean all paths are direct paths to losing.
- cedws 8mo agoDefine "losing." Europe is prematurely regarded as having lost the AI race. And yet a large portion of Europe live higher quality lives compared to their American counterparts, live longer, and don't have to worry about an elected orange unleashing brutality on them.
- thethimble 8mo agoIf the world is built on AI infrastructure (models, compute, etc.) that is controlled by the CCP then the west has effectively lost. This may lead to better life outcomes, but if the west doesn't control the whole stack then they have lost their sovereignty. This is already playing out today as Europe is dependent on the US for critical tech infrastructure (cloud, mail, messaging, social media, AI, etc). There's no home grown European alternatives because Europe has failed to create an economic environment to assure its technical sovereignty.
- deleted 8mo ago[deleted]
- 8mo ago
- sathish316 8mo agoAI commoditized to the point where Nash Equilibrium and 35 minutes between announcements matter :)
- granzymes 8mo agoI think Anthropic rushed out the release before 10am this morning to avoid having to put in comparisons to GPT-5.3-codex! The new Opus 4.6 scores 65.4 on Terminal-Bench 2.0, up from 64.7 from GPT-5.2-codex. GPT-5.3-codex scores 77.3.
- __jl__ 8mo agoImpressive jump for GPT-5.3-codex and crazy to see two top coding models come out on the same day...
- granzymes 8mo agoInsane! I think this has to be the shortest-lived SOTA for any model so far. Competition is amazing.
- the_duke 8mo agoI do not trust the AI benchmarks much, they often do not line up with my experience. That said ... I do think Codex 5.2 was the best coding model for more complex tasks, albeit quite slow. So very much looking forward to trying out 5.3.
- NitpickLawyer 8mo agoJust some anecdata++ here but I found 5.2 to be really good at code review. So I can have something crunched by cheaper models, reviewed async by codex and then re-prompt with the findings from the review. It finds good things, doesn't flag nits (if prompted not to) and the overall flow is worth it for me. Speed loss doesn't impact this flow that much.
- kilroy123 8mo agoPersonally, I have Claude do the coding. Then 5.2-high do the reviewing.
- 8mo ago
- verdverm 8mo ago[flagged]
- deleted 8mo ago[deleted]
- fishpham 8mo agoModel card: https://cdn.openai.com/pdf/23eca107-a9b1-4d2c-b156-7deb4fbc697c/GPT-5-3-Codex-System-Card-02.pdf https://cdn.openai.com/pdf/23eca107-a9b1-4d2c-b156-7deb4fbc6...
- raincole 8mo agoAlmost like Anthropic and OpenAI are trying to front run each other
- kingstnap 8mo agoThat was fast! I really do wonder whats the chain here. Did Sam see the Opus announcement and DM someone a minute later?
- Mond_ 8mo agoOpenAI has a whole history of trying to scoop other providers. This was a whole thing for Google launches, where OpenAI regularly launched something just before Google to grab the media attention.
- rsanek 8mo agoSome recent examples: GPT-4o vs. Google I/O (May 2024): OpenAI scheduled its "Spring Update" exactly 24 hours before Google’s biggest event of the year, Google I/O. They launched GPT-4o voice mode. Sora vs. Gemini 1.5 Pro (Feb 2024): Just two hours after Google announced its breakthrough Gemini 1.5 Pro model, Sam Altman tweeted the reveal of Sora (text-to-video). ChatGPT Enterprise vs. Google Cloud Next (Aug 2023): As Google began its major conference focused on selling AI to businesses, OpenAI announced ChatGPT Enterprise.
- maxpert 8mo agoTell me that you are hurt without telling me that you are hurt this applies to Sam right now
- NewsaHackO 8mo agoI assume some sort of corporate espionage. This is high stakes after all
- simianwords 8mo agoAny notes on pricing?
- kingstnap 8mo ago> GPT‑5.3-Codex was co-designed for, trained with, and served on NVIDIA GB200 NVL72 systems. We are grateful to NVIDIA for their partnership. This is hilarious lol
- uh_uh 8mo agoHow so?
- Philpax 8mo agoThey're on shaky ground right now https://arstechnica.com/information-technology/2026/02/five-months-later-nvidias-100-billion-openai-investment-plan-has-fizzled-out/ https://arstechnica.com/information-technology/2026/02/five-...
- kingstnap 8mo agoIts kind of a suck up that more or less confirms the beef stories that were floating around this past week. In case you missed it. For example: Nvidia's $100 billion OpenAI deal has seemingly vanished - Ars Technica https://arstechnica.com/information-technology/2026/02/five-months-later-nvidias-100-billion-openai-investment-plan-has-fizzled-out/ https://arstechnica.com/information-technology/2026/02/five-... Specifically this paragraph is what I find hilarious. > According to the report, the issue became apparent in OpenAI’s Codex, an AI code-generation tool. OpenAI staff reportedly attributed some of Codex’s performance limitations to Nvidia’s GPU-based hardware.
- esafak 8mo ago> OpenAI staff reportedly attributed some of Codex’s performance limitations to Nvidia’s GPU-based hardware. They should design their own hardware, then. Somehow the other companies seem to be able to produce fast-enough models.
- sumedh 8mo ago> They should design their own hardware They made a deal with Cerebras for fast inference.
- shibeprime 8mo agoI know we just got a reset and a 2× bump with the native app release, but shipping 5.3 with no reset feels mismatched. If I’d known this was coming, I wouldn’t have used up the quota on the previous model.
- trilogic 8mo agoWhen 2 multi billion giants advertise same day, it is not competition but rather a sign of struggle and survival. With all the power of the "best artificial intelligence" at your disposition, and a lot of capital also all the brilliant minds, THIS IS WHAT YOU COULD COME UP WITH? Interesting
- rishabhaiover 8mo agoWhat happened to you?
- raincole 8mo agoAI fried brains, unfortunately.
- wasmainiac 8mo agoI mean, he has a point it’s just not very eloquently written.
- trilogic 8mo agoI empathize with the situation, no elegance from them, no eloquence from me :)
- deleted 8mo ago[deleted]
- sdf2erf 8mo agoYeah they are both fighting for survival. No surprise really. Need to keep the hype going if they are both IPO'ing later this year.
- superze 8mo agoHow many IPOs can a company really do?
- edem 8mo agoSo can I use this from Opencode? Because Anthropic started to enforce their TOS to kill the Opencode integration
- rs_rs_rs_rs_rs 8mo agoYou can use Anthropic models in Opencode, make an api key and you're good to do(you can even use the in house Opencode router, Zen). What you can't do is pretend opencode is claude code to make use of that specific claude code subscription.
- tfehring 8mo agoOpenAI models in general, yes - `opencode auth login`, select OpenAI, then ChatGPT Pro/Plus. I just checked and 5.3-codex isn't available in opencode yet, but I assume it will be soon.
- InsideOutSanta 8mo agoYes, OpenAI said they'd allow usage of their subscriptions in opencode.
- regularfry 8mo agoI've tried opus 4.5 in opencode via the GitHub Copilot API, mostly to see if it works all. I don't think that broke any terms of service? But also I haven't checked how much more expensive I made it for myself over just calling them directly.
- avb 8mo agoYou can also use via Opencode Zen, Github Copilot, or probably any number of other model providers that Opencode integrates with. Not sure why everyone stays focused on getting it from Anthropic or OpenAI directly when there are so many places to get access to these models and many others for the same or less money.
- Robin_f 8mo agoAnthropic mostly had an advantage in speed. It feels like with a 25% increase in speed with Codex 5.3, they are now losing that advantage as well.
- smith7018 8mo agoI just asked Opus 4.6 to debug a bug in my current changes and it went for 20 minutes before I interrupted it. Take that as you will.
- bgirard 8mo agoDoesn't feel like a useful data point without more context. For some hard bugs I'd be thrilled to wait 30 minutes for a fix, for a trivial CSS fix not so much. I've spent weeks+ of my career fix single bugs. Context is everything.
- smith7018 8mo agoSure, but I've never experienced a 20 minute wait with CC before. It was an architectural question but it would have taken a couple minutes with a definitive answer on 4.5.
- sejje 8mo ago> I've spent weeks+ of my career fix single bugs. Same, same. It's not a useful data point at all. bug: llm alignment timeframe to fix : probably never
- mrcwinn 8mo agoAs they point out in their blog post, 4.6 intentionally thinks longer, but you can adjust it from the CLI.
- deleted 8mo ago[deleted]
- maxpert 8mo agoIs this me or Sam is being absolute sore loser he is and trying to steal Opus thunder?
- wahnfrieden 8mo agoYou could also claim that Anthropic is trying to scoop OpenAI by launching minutes earlier, as OpenAI has done with Google in the past. For downvoters, you must be naive to think these companies are not surveilling each other through various means.
- OutOfHere 8mo agoThey both are doing this to each other. BTW, loser is spelled with a single o.
- nickthegreek 8mo agoWhy is it loser? He very well could be a sore winner here.
- koakuma-chan 8mo agoOpenAI is still the only AI company that has structured outputs. Anthropic now supports JSON schema but you can't specify array length.
- wahnfrieden 8mo agoCan you elaborate what you mean - OAI structured outputs means JSON schema doesn't it? So are you just saying they both support JSON schema but Anthropic has a limitation?
- koakuma-chan 8mo agoOpenAI, in addition to JSON schema, supports "context-free grammar"[0], i.e. regex and lark. Anthropic also supports JSON schema since a few weeks ago, but they don't support specifying the length of JSON array, so you still have to worry about the model producing invalid output. [0]: https://platform.openai.com/docs/guides/function-calling#context-free-grammars https://platform.openai.com/docs/guides/function-calling#con... One thing that pisses me off is this widespread misunderstanding that you can just fall back to function calling (Anthropic's function calling accepts JSON schema for arguments), and that it's the same as structured outputs. It is not. They just dump the JSON schema into the context without doing the actual structured outputs. Vercel's AI SDK does that and it pisses me off because doing that only confuses the model and prefilling works much better.
- binsquare 8mo agoAt first try it solved a problem that 5.2 couldn't previously. Seems to be slower/thinks longer.
- OutOfHere 8mo agoIt is absurd to release 5.3-Codex before first releasing 5.3. Also, there is no reason for OpenAI and Anthropic to be trying to one-up each other's releases on the same day. It is hell for the reader.
- apetresc 8mo agoWhy is it absurd?
- OutOfHere 8mo agoAt the very least, it is absurd to announce a model but not release it on the same day, making it vaporware. Was it released?
- apetresc 8mo agoWhich model, 5.3 or 5.3-Codex? Yes, 5.3-Codex was announced and released. 5.3 wasn't announced. None of it is "absurd", and it also wouldn't have been "absurd" if they announce something but don't release it that same day (which they didn't do, but if they had - what exactly is absurd about that? Companies make announcements about future releases ALL the time.)
- tomashubelbauer 8mo agoI agree, I was confused about where 5.3 non Codex was. 5.2-Codex disappointed me enough that I won't be giving 5.3 Codex a try, but I'm looking forward to trying 5.3 non Codex with Pi.
- sunaookami 8mo agoGPT-5.x in general are very disappointing, the only good chat model was GPT-5 in the first week before they made "the personality warmer" and Codex in general was always kinda meh.
- aurareturn 8mo agoBecause Claude Code is stealing the thunder so OpenAI is focusing on coding now.
- copilot_king_2 8mo ago[flagged]
- modeless 8mo agoIt's so difficult to compare these models because they're not running the same set of evals. I think literally the only eval variant that was reported for both Opus 4.6 and GPT-5.3-Codex is Terminal-Bench 2.0, with Opus 4.6 at 65.4% and GPT-5.3-Codex at 77.3%. None of the other evals were identical, so the numbers for them are not comparable.
- input_sh 8mo agoIt's better on a benchmark I've never heard of!? That is groundbreaking, I'm switching immediately!
- modeless 8mo agoI also wasn't that familiar with it, but the Opus 4.6 announcement leaned pretty heavily on the TerminalBench 2.0 score to quantify how much of an improvement it was for coding, so it looks pretty bad for Anthropic that OpenAI beat them on that specific benchmark so soundly. Looking at the Opus model card I see that they also have by far the highest score for a single model on ARC-AGI-2. I wonder why they didn't advertise that.
- input_sh 8mo agoNo way! Must be a coinkydink, no way OpenAI knew ahead of time that Anthropic was gonna put a focus on that specific useless benchmark as opposed to all the other useless benchmarks!? I'm firing 10 people now instead of 5!
- rsanek 8mo agoI usually wait to see what ArtificialAnalysis says for a direct comparison.
- alexhans 8mo agoIsn't the best eval the one you build yourself, for your own use cases and value production? I encourage people to try. You can even timebox it and come up with some simple things that might look initially insufficient but that discomfort is actually a sign that there's something there. Very similar to moving from not having unit/integration tests for design or regression and starting to have them.
- xiphias2 8mo ago,,GPT‑5.3-Codex is the first model we classify as High capability for cybersecurity-related tasks under our Preparedness Framework , and the first we’ve directly trained to identify software vulnerabilities. While we don’t have definitive evidence it can automate cyber attacks end-to-end, we’re taking a precautionary approach and deploying our most comprehensive cybersecurity safety stack to date. Our mitigations include safety training, automated monitoring, trusted access for advanced capabilities, and enforcement pipelines including threat intelligence.'' While I love Codex and believe it's amazing tool, I believe their preparedness framework is out of date. As it is more and more capable of vibe coding complex apps, it's getting clear that the main security issues will come up by having more and more security critical software vibe coded. It's great to look at systems written by humans and how well Codex can be used against software written by humans, but it's getting more important to measure the opposite: how well humans (or their own software) are able to infiltrate complex systems written mostly by Codex, and get better on that scale. In simpler terms: Codex should write secure software by default.
- mrkeen 8mo agoIs "high-capability" a stronger or weaker claim than "team of phd-level experts"? https://www.nbcnews.com/tech/tech-news/openai-releases-chatgpt-5-rcna223265 https://www.nbcnews.com/tech/tech-news/openai-releases-chatg...
- semiinfinitely 8mo agomuch stronger
- Xunjin 8mo agoDon't forget that is also Harder, Better, Faster.
- trcf23 8mo agoThat’s just classical OpenAI trying to make us believe they’re closing on AGI… Like all « so called » research from them and Anthropic about safety alignment and that their tech is so incredibly powerful that guardrails should be put on them.
- mannanj 8mo ago[flagged]
- GenerWork 8mo agoI find it very, very interesting how they demoed visuals in the form of the “soft SaaS” website and mentioned how it can do user research. Codex has usually lagged behind Claude and Gemini when it comes to UX, so I’m curious to see if 5.3 will take the lead in real world use. Perhaps it’ll be available in Figma Make now?
- brokencode 8mo agoI’m hoping they add better IDE integration to track active file and selection. That’s the biggest annoyance I have in working with Codex.
- copilot_king 8mo ago[dead]
- imasliev 8mo agoGPT-5.2-Codex was so cool at price/value rate, hope 5.3 will not ruin the race with claude
- I_am_tiberius 8mo agoI'd like to know if and how much illegal use of customer prompts are used for training.
- renewiltord 8mo agoOh yeah that’s in the “These Are The Illegal Things We Did” section 7.4 in the Model Card.
- xlbuttplug2 8mo ago"But we anonymize prompts before training!" Meanwhile the prompt: Crop this photo of my passport
- wahnfrieden 8mo agoPelican seems much worse than the Opus 4.6 one (though the bicycle is more accurate): https://gist.github.com/simonw/a6806ce41b4c721e240a4548ecdbe216?permalink_comment_id=5972149#gistcomment-5972149 https://gist.github.com/simonw/a6806ce41b4c721e240a4548ecdbe...
- deleted 8mo ago[deleted]
- tosh 8mo agoTerminal Bench 2.0 | Name | Score | |---------------------|-------| | OpenAI Codex 5.3 | 77.3 | | Anthropic Opus 4.6 | 65.4 |
- greenfish6 8mo agoyea but i feel like we are over the hill on benchmaxxing, many times a model has beaten anthropic on a specific bench, but the 'feel' is that it is still not as good at coding
- falloutx 8mo agoWhen Anthropic beats Benchmarks its somehow earned, when OpenAi games it, its somehow about not feeling good at coding.
- apetresc 8mo agoI mean… yeah? It sounds biased or whatever, but if you actually experience all the frontier models for yourself, the conclusion that Opus just has something the others don’t is inescapable.
- manmal 8mo agoOpus is really good at bash, and it’s damn fast. Codex is catching up on that front, but it’s still nowhere near. However, Codex is better at coding - full stop.
- AstroBen 8mo ago'feel' is no more accurate not saying there's a better way but both suck
- thethimble 8mo agoSpeak for yourself. I've been insanely productive with Codex 5.2. With the right scaffolding these models are able to perform serious work at high quality levels.
- morleytj 8mo agoThe behind the scenes on deciding when to release these models has got to be pretty insanely stressful if they're coming out within 30 minutes-ish of each other.
- Havoc 8mo agoIt’s also functionally not likely without some sort of insider knowledge or coordination
- morleytj 8mo agoCould be, could also be situations where things are lined up to launch in the near future and then a mad dash happens upon receiving outside news of another launch happening. I suppose coincidences happen too but that just seems too unlikely to believe honestly. Some sort of knowledge leakage does seem like the most likely reason.
- sumedh 8mo agoThe AI labs tell their partners when the models are coming out, the partners might be sharing the news with their sources in other AI labs.
- meisel 8mo agoI wonder if their "5.3" was continuously being updated, with regenerated benchmarks with each improvement, and they just stayed ready to release it when claude released
- morleytj 8mo agoThis seems plausible. It would be shocking if these companies didn't have an automated testing suite which is recomputing these benchmarks on a regular basis, and uploading to a dashboard for supervision. Given that they already pre-approved various language and marketing materials beforehand there's no real reason they couldn't just leave it lined up with a function call to go live once the key players make the call.
- heraldgeezer 8mo agoAnthropic and GTP 2 new models at once?
- jdthedisciple 8mo agoGotta love how the game demo's page title is "threejs" – I guess the point was to demo its vibe-coding abilities anyway, but yea..
- prng2021 8mo agoDid they post the knowledge cutoff date somewhere
- gwd 8mo agogpt-5.3-codex isn't available on the API yet. From TFA: > We are working to safely enable API access soon.
- ecshafer 8mo agoFunny that this and Opus 4.6 released within minutes of each other. Each showing similar score improvements. Each claiming to be revolutionary.
- __mharrison__ 8mo agoI never really used Codex (found it to slow) just 5.2, which I going to be an excellent model for my work. This looks like another step up. This week, I'm all local though, playing with opencode and running qwen3 coder next on my little spark machine. With the way these local models are progressing, I might move all my llm work locally.
- andix 8mo agoI think codex got much faster for smaller tasks in the last few months. Especially if you turn thinking down to medium.
- raffkede 8mo agoI think the slow feeling is a UI thing in codex
- __mharrison__ 8mo agoI realize my comment was unclear. I use codex the CLI all the time, but generally with this invocation: `codex --full-auto -m gpt-5.2` However, when I use the 5.2codex model, I've found it to be very slow and worse (hard to quantify, but I preferred straight-up 5.2 output).
- foft 8mo agoHaving used codex a fair bit I find it really struggles with … almost anything. However using the equivalent chat gpt model is fantastic. I guess it’s a matter of focus and being provided with a smaller set of code to tackle.
- sumedh 8mo agoCan you share your prompts?
- roya51788 8mo agowhat are the benchmarks against opus 4.6?
- itay-maman 8mo agoSomething that caught my eye from the announcement: > GPT‑5.3‑Codex is our first model that was instrumental in creating itself. The Codex team used early versions to debug its own training I'm happy to see the Codex team moving to this kind of dogfooding. I think this was critical for Claude Code to achieve its momentum.
- aurareturn 8mo agoMore importantly, this is the early steps of a model self improving itself. Do we still think we'll have soft take off?
- reducesuffering 8mo agoThis has already been going on for years. It's just that they were using GPT 4.5 to work on GPT 5. All this announcement mean is that they're confident enough in early GPT 5.3 model output to further refine GPT 5.3 based on initial 5.3. But yes, takeoff will still happen because of this recursive self improvement works, it's just that we're already past the inception point.
- mirsadm 8mo agoI can't tell if this is a serious conversation anymore.
- reducesuffering 8mo ago“Best start believing in science fiction stories. You're in one.” https://x.com/TheZvi/status/2017310187309113781 https://x.com/TheZvi/status/2017310187309113781
- Davidzheng 8mo agoI think it's important in AI discussions to reason correctly from fundamentals and not disregard possibilities simply because they seem like fiction/absurd. If the reasoning is sound, it could well happen.
- ponyous 8mo agoI think models are smart enough for most of the stuff, these little incremental changes barely matter now. What I want is the model that is fast.
- derac 8mo agoThis is faster if their marketing is right, it uses significantly less tokens. Gemini 3 flash is very good as well.
- energy123 8mo agoI predict a bifurcation in usage. Serial usecases ("fix this syntax errors") will go on Cerebras and get 10x faster. Deep usecases ("solve Riemann hypothesis") will become massively parallel and go on slower inference compute. Teams will stitch both together because some workflows go through stages of requiring deep parallel compute ("scan my codebase for bugs and propose fixes") followed by serial compute ("dedupe and apply the 3 fixes, resolve merge conflict").
- newtwilly 8mo agoI've been using 5.1-codex-max with low reasoning (in Cursor fwiw) recently and it feels like a nice speed while still being effective. Might be worth a shot.
- hubraumhugo 8mo agoAnybody else not seeing it available in Codex app or CLI yet (with Plus)?
- haneul 8mo agoMy codex CLI didn’t notice version bump available, but I manually did pnpm add -g @openai/codex and 5.3 was there after.
- kopollo 8mo agoWhere is the google?
- hsaliak 8mo agogemini-3-flash-preview will be GA soon i hope. /s
- rustyhancock 8mo agoAnyone remember the dot-com era when you would see one provider claim the most miles of fibre and then later that week another would have the title?
- dawidg81 8mo agoMay AI not write the code for me. May I at least understand what it has "written". AI help is good but don't replace real programmers completely. I'm enough copy pasting code i don't understand. What if one day AI will fall down and there will be no real programmers to write the software. AI for help is good but I don't want AI to write whole files into my project. Then something may broke and I won't know what's broken. I've experienced it many times already. Told the AI to write something for me. The code was not working at all. It was compiling normally but the program was bugged. Or when I was making some bigger project with ChatGPT only, it was mostly working but after a longer time when I was promting more and more things, everything got broken.
- katspaugh 8mo agoHonest question: have you tried evolving your code architecture when adding features instead of just "promting more and more things"?
- dawidg81 8mo agoI've tried that too but it was almost the same, chatgpt kept forgetting many things about the code and project structure. In summary AI can get problematic for me and i get with troubles with it. This is like one of the reasons why I still prefer traditional text editor for writing code like Vim over a "software on steroids" like VS Code and things like that...
- pixl97 8mo ago> What if one day AI will fall down and there will be no real programmers to write the software. What if you want to write something very complex now that most people don't understand? You keep offering more money until someone takes the time to learn it and accomplish it, or you give up. I mean, there are still people that hammer out horseshoes over a hot fire. You can get anything you're willing to pay money for.
- nubg 8mo agoSorry but companies will not hire you but instead a person who learned how to code with AI. Get with the times or lose.
- bg24 8mo agoI am on a max subscription for Claude, and hate the fact that OpenAI have not figured out that $20 => $200 is a big jump. Good luck to them. In terms of model, just last night, Codex 5.2 solved a problem for me which other models were going round and round. Almost same instructions. That said, I still plan to be on $100 Claude (overall value across many tasks, ability to create docs, co-work), and may bump up OpenAI subscription to the next tier should they decide to introduce one. Not going to $200 even with 5.3, unless my company pays for it.
- andix 8mo agoI guess the jump is on purpose. You can buy Codex credits and also use codex via the API (manual switching required).
- aerhardt 8mo agoI'm coding about 6-9h per day with Codex CLI on the $20 Plus sub, occasionally switching to extra-high reasoning and feeding it massive contexts, all tools enabled, sometimes 2-3 terminal sessions running in parallel and I've never hit limits... I operate on small-ish codebases but even so I try to work in the most local scope possible with AGENTS.md at the sub-directory levels. Are you really hitting limits, or are you turned off by the fact you think you will?
- bg24 8mo agoYou are correct :-) I am turned off by the fact that I will hit the limit if I used more. But you gave me confidence. I guess $20 can go a long way. I think only once in the last 3 months I got rate limited in Codex.
- wiether 8mo agoI use Codex in OpenCode through the API and find the experience quite enjoyable.
- bg24 8mo agoNeed to try OpenCode. Thanks.
- bryanhogan 8mo agoThe most important question: Can it do Svelte now?
- speedgoose 8mo agoToday is the best day to rewrite everything in React. You may not enjoy React, but AI agents do. And they are the ones writing the code.
- bryanhogan 8mo agoBut human and AI agents enjoy writing Svelte even more. This really is a non-argument.
- speedgoose 8mo agoI don’t know, you ask above whether it can do svelte now.
- davidmurdoch 8mo ago5.2 was already very good with svelte 5, at least when you have the svelte MCP server set up.
- davidmurdoch 8mo agoI've been using 5.2 the way they're describing the new use case for 5.3 this whole time.
- tyfon 8mo agoI'm having a hard time parsing the openai website. Anyone know if it is possible to use this model with opencode with the plus subscription?
- mbil 8mo agoIt's possible to use opencode with the plus subscription using this plugin for auth [0][1]. Just tested this and it appears to work. [0]: https://opencode.ai/docs/ecosystem/#:~:text=Use%20your%20ChatGPT%20Plus%2FPro%20subscription%20instead%20of%20API%20credits https://opencode.ai/docs/ecosystem/#:~:text=Use%20your%20Cha... [1]: https://github.com/numman-ali/opencode-openai-codex-auth https://github.com/numman-ali/opencode-openai-codex-auth
- fisf 8mo agoYou do not need a plugin anymore.
- karmasimida 8mo agoFor those who cared: GPT-5.3-Codex dominates terminal coding with a roughly 12% lead (Terminal-Bench 2.0), while Opus 4.6 retains the edge in general computer use by 8% (OSWorld). Anyone knows the difference between OSWorld vs OSWorld Verified?
- nopinsight 8mo agoFrom Claude 4.6 Thinking: OSWorld is the full 369-task benchmark. OSWorld Verified is a ~200-task subset where humans have confirmed the eval scripts reliably score success/failure — the full set has some noisy grading where correct actions can still get marked wrong. Scores on Verified tend to run higher, so they're not directly comparable.
- bgirard 8mo ago> Using the develop web game skill and preselected, generic follow-up prompts like "fix the bug" or "improve the game", GPT‑5.3-Codex iterated on the games autonomously over millions of tokens. I wish they would share the full conversation, token counts and more. I'd like to have a better sense of how they normalize these comparisons across version. Is this a 3-prompt 10m token game? a 30-prompt 100m token game? Are both models using similar prompts/token counts? I vibe coded a small factorio web clone [1] that got pretty far using the models from last summer. I'd love to compare against this. [1] https://factory-gpt.vercel.app/ https://factory-gpt.vercel.app/
- veb 8mo agoI just wanted to say that's a pretty cool demo! I hadn't realised people were using it for things like this.
- bgirard 8mo agoThank you. There's a demo save to get the full feel of it quickly. There's also a 2D-ASCII and 3D render you can hotswap between. The 3D models are generated with Meshy. The entire game is 'AI slop'. I intentionally did no code reviews to see where that would get me. Some prompts were very specific but other prompts were just 'add a research of your choice'. This was built using old versions of Codex, Gemini and Claude. I'll probably work on it more soon to try the latest models.
- gspetr 8mo agoAny estiimates on how much it cost you? In terms of total real world time, money, and time spent by the agents.
- bgirard 8mo agoAbout ~$300: $200 for Claude max subscription $20 for Vercel $20 for Codex $20 for Meshy I think these days the $200 Max subscription wouldn't be needed. I bet with these latest models you can make due with mixing two $20/mo subscriptions. Real time was 2 weeks of watching the agents while watching TV and playing games, waiting for limit resets, etc... Very little decided focused time.
- nananana9 8mo agoI've been listening to the insane 100x productivity gains you all are getting with AI and "this new crazy model is a real game changer" for a few years now, I think it's about time I asked: Can you guys point me ton a single useful, majority LLM-written, preferably reliable, program that solves a non-trivial problem that hasn't been solved before a bunch of times in publicly available code?
- beernet 8mo agoCan you point me to a human written program an LLM cannot write? And no, just answering with a massively large codebase does not count because this issue is temporary. Some people just hate progress.
- falloutx 8mo agoEven a normal website like landonorris.com. Try copying all those effects with AI. Another example: Red Dead Redemption 2 Another one: Roller coaster tycoon Another one: ShaderToy
- satvikpendem 8mo agoWhy do you believe an LLM can't write these, just because they're 3D? If the assets are given (just as with a human game programmer, who has artists provide them the assets), then an LLM can write the code just the same.
- falloutx 8mo agoWhat? People can easily get assets, thats not a even a problem in 2026. Roller coaster tycoon's assets were done by the programmer himself. If its so easy why haven't we seen actually complex pieces of software done in couple of weeks by LLM users? Also try building any complex effects by prompting LLMs, you wont get any far, this is why all of the LLM coded websites look stupidly bland.
- 8mo ago
- PieUser 8mo agoHow'd they both release at the same time? Insiders?
- Rperry2174 8mo agoWhats interesting to me is that these gpt-5.3 and opus-4.6 are diverging philosophically and really in the same way that actual engineers and orgs have diverged philosophically With Codex (5.3), the framing is an interactive collaborator: you steer it mid-execution, stay in the loop, course-correct as it works. With Opus 4.6, the emphasis is the opposite: a more autonomous, agentic, thoughtful system that plans deeply, runs longer, and asks less of the human. that feels like a reflection of a real split in how people think llm-based coding should work... some want tight human-in-the-loop control and others want to delegate whole chunks of work and review the result Interested to see if we eventually see models optimize for those two philosophies and 3rd, 4th, 5th philosophies that will emerge in the coming years. Maybe it will be less about benchmarks and more about different ideas of what working-with-ai means
- karmasimida 8mo ago> With Codex (5.3), the framing is an interactive collaborator: you steer it mid-execution, stay in the loop, course-correct as it works. > With Opus 4.6, the emphasis is the opposite: a more autonomous, agentic, thoughtful system that plans deeply, runs longer, and asks less of the human. Ain't the UX is the exact opposite? Codex thinks much longer before gives you back the answer.
- xd1936 8mo agoI've also had the exact opposite experience with tone. Claude Code wants to build with me, and Codex wants to go off on its own for a while before returning with opinions.
- gallerdude 8mo agoBoth Opus 4.6 and GPT-5.3 one shot a Gameboy emulator for me. Guess I need a better benchmark.
- paxys 8mo agoAs coding agents get "good enough" the next differentiator will be which one can complete a task in fewer tokens.
- tgtweak 8mo agoOr quicker, or more comprehensively for the same price.
- nlh 8mo agoOr the same number of tokens in less time. Kinda feels like the CPU / modem wars of the 90s all over again - I remember those differences you felt going from a 386 -> 486 or from a 2400 -> 9600 baud modem. We're in the 2400 baud era for coding agents and I for one look forward to the 56k era around the corner ;)
- well_ackshually 8mo agoThere's hundreds of gameboy emulators available on Github they've been trained on. It's quite literally the simplest piece of emulation you could do. The fact that they couldn't do it before is an indictment of how shit they were, but a gameboy emulator should be a weekend project for anyone even ever so slightly qualified. Your benchmark was awful to begin with.
- nubg 8mo agolmao so cringe that they delay releasing the model until anthropic does
- sumedh 8mo agoIts good from a marketing perspective though, steal the thunder of your competitor.
- dllrr 8mo agoUsing opus 4.6 in claude code right now. It's taking about 5x longer to think things through, if not more.
- andyferris 8mo agoThe notes explicitly call out you may want to dial the effort setting back to medium to reduce latency/tokens (high being default, apparently there is a max setting too).
- gverrilla 8mo agoThere's 3 options to choose from on /model: Low, medium and high effort.
- jpau 8mo agoInteresting that this was released without a prior GPT-5.3 release. I wonder if that means we won't see a GPT-5.3?
- koolala 8mo agoI want to recompile a Rust project to be f32 instead of f64. Am I better off buying 1 month of Codex, Claude, or Antigravity? I want to have the agent continuesly recompile and fix compile errors on loop until all the bugs from switching to f32 are gone.
- EmilStenstrom 8mo agoDoesn't matter which one. All of them can do things like this now, given a good enough feedback loop. Which your problem has.
- argsnd 8mo agoAll of them can do it but Codex has the least frustrating usage limits.
- koolala 8mo agoWhen using it in VSCode? The browser system running its own container seems like it would be the most demanding on their resources. The stand-alone client is Mac-only but I don't know if it makes a difference. My goal is to do it within the usage I get from a $20 monthly plan.
- energy123 8mo agoWhy would you use it in VSCode? OpenAI are offering double the normal usage limits for Codex for two months. Go with them and do it in the terminal or the Mac OS codex app if you have a Mac.
- SunshineTheCat 8mo agoI've always been fascinated to see significantly more people talking about using Claude than I see people talking about Codex. I know that's anecdotal, but it just seems Claude is often the default. I'm sure there are key differences in how they handle coding tasks and maybe Claude is even a little better in some areas. However, the note I see the most from Claude users is running out of usage. Coding differences aside, this would be the biggest factor for me using one over the other. After several months on Codex's $20/mo. plan (and some pretty significant usage days), I have only come close to my usage limit once (never fully exceeded it). That (at least to me) seems to be a much bigger deal than coding nuances.
- fHr 8mo agoCodex is great and I hit the usage once doing multiagent full 5 hour absolute degen session for the nornal workflow alongside never hit it and now x2 useage even and now with the planmode switch back and forth absolute great.
- AstroBen 8mo agoI'm with you. Codex's plans seems to be a much more generous offering than Claude I just.. can't tell a different in quality between them.. so I go for the cheapest
- superfrank 8mo agoI only switched to using the terminal based agents in the last week. Prior to this I was pretty much only using it through Cursor and GH Copilot. The Anthropic models when used through GH Copilot were far superior to the codex ones and I didn't really get the hype of Codex. Using them through the CLI though, Codex is much better, IMO. My guess is that it's potentially that and just momentum from developers who started using CC when it was far superior to Codex has allowed it to become so much more popular. Potentially, it's might be that, as it's more autonomous, it's better for true vibe-coding and it's more popular with the Twitter/LinkedIn wantrepreneur crew which meant it gets a lot of publicity which increases adoption quicker.
- jorl17 8mo ago
- petetnt 8mo agoWhoa, I think GPT-5.2-Codex was a disappointment, but GPT-5.3-Codex is definitely the future!
- drcongo 8mo agoDoes it insert adverts in your code?
- xyst 8mo ago[flagged]
- mrcwinn 8mo agoAccording to Sam Altman, Anthropic is for "rich people." Judging by his $4 million man-baby Koeniggsegg, he must be a huge Claude Code user!
- swordsith 8mo agoHe would be! If they didn't get banned from using it in the OAI offices. He's so mad.
- RivieraKid 8mo agoDo software engineers here feel threatened by this? I certainly am. I'm surprised that this topic is almost entirely missing in these threads.
- ReptileMan 8mo agoJevons paradox hints that the situation is not as bleak as it sounds.
- svachalek 8mo agoI've been in this profession for 32 years now and this is my experience. Every time coding gets easier or cheaper, the response is first to lay off developers but quickly the demand for more software spikes and they need everyone back and more than ever. When we achieve true AGI we're truly cooked, but it won't just be software developers by definition of AGI, it will be everyone else too. But the last people in the building before they turn the lights out for good will be the software developers.
- anthonypasq 8mo agoi think i fundamentally agree that the demand for code is essentially infinite. Code has just been notoriously expensive and therefore it could only de deployed towards the most economically efficient activities. this is now changing.
- worldsavior 8mo agoNo. AI does not work well enough, you still need a person to look on it and CODE. It probably never will, until AGI which probably also in my opinion will never come.
- dude250711 8mo agoIt's a super-special AI tier that can replace developers and other grunts, yet somehow cannot replace managers and C-suite. It can only replace whoever is not writing a fat cheque to it.
- 8mo ago
- virtualzx 8mo agois so fun that the two releases used almost completely non-overlapping benchmarks!
- vatsachak 8mo agoAI designed websites are so easy to spot that I need to actively design my UI so that it doesn't look AI
- textlapse 8mo agoI would love to see a nutritional facts label on how many prompts / % of code / ratio of human involvement needed to use the models to develop their latest models for the various parts of their systems.
- jiggawatts 8mo agoI think this announcement says a lot about OpenAI and their relationship to partners like Microsoft and NVIDIA, not to mention the attitude of their leadership team. On Microsoft Foundry I can see the new Codex 4.6 model right now, but GPT-5.3 is nowhere to be seen. I have a pre-paid account directly with OpenAI that has credits, but if I use that key with the Codex CLI, it can't access 5.3 either. The press release very prominently includes this quote: "GPT‑5.3-Codex was co-designed for, trained with, and served on NVIDIA GB200 NVL72 systems. We are grateful to NVIDIA for their partnership." Sounds like OpenAI's ties with their vendors are fraying while at the same time they're struggling to execute on the basics like "make our own models available to our own coding agents", let alone via third-party portals like Microsoft Foundry.
- zozbot234 8mo agoGPT 5.3 is not in the API yet AIUI.
- jiggawatts 8mo agoTranslation: "We've announced this great new thing that we're struggling to make available on channels we control, unlike our competitors who seem to have no issues despite a fraction of our budget!"
- tombert 8mo agoActually kind of excited for this. I've been using 5.2 for awhile now, and it's already pretty impressive if you set the context window to "high". Something I have been experimenting with is AI-assisted proofs. Right now I've been playing with TLAPS to help write some more comprehensive correctness proofs for a thing I've been building, and 5.2 didn't seem quite up to it; I was able to figure out proofs on my own a bit better than it was, even when I would tell it to keep trying until it got it right. I'm excited to see if 5.3 fairs a bit better; if I can get mechanized proofs working, then Fields Medal here I come!
- sidgarimella 8mo agoMany are saying codex is more interactive but ironically I think that very interactivity/determinism works best when using codex remotely as a cloud agent and in highly async cases. Conversely I find opus great locally, where I can ram messages into it to try to lever its autonomy best (and interrupt/clean up)
- synergy20 8mo agoi like the opus 4.6 announcement a lot more, concise and to the point. for the 5.3 codex, it's a long post, but still, the most important info, the context window, is nowhere to be found. thus, I'm keeping using opus.
- mmaunder 8mo agoTake a screenshot of ARG-AGI-2 leaderboard now because GPT-5.3-Codex isn't up there yet and I suspect it'll cram down Claude Opus 4.6 which rules the roost for the next few hours. King for a day.
- farazbabar 8mo agoI have wanted to hold back from answering comments that ask for proof of real work/productivity gains because everyone works differently, has different skill levels and frankly not everyone is working on world changing stuff. I really liked a comment someone made a few of these posts ago, these models are amazing! amazing! if you don't actually need them, but if you actually do need them, you are going to find yourself in a world of hurt. I cannot agree more, I (believe) I am a good software engineer, I have developed some interesting pieces of software over the decades and usually when I got passionate about a project, I could do really interesting things within weeks, sometimes months. I will say this, I am working on some really cool stuff, stuff I cannot tell you about, or else. And my velocity is for what used to take months is days and hours for what used to take weeks. I still review everything, I understand all the gotchas of distributed systems, performance, latency/throughput, C, java, SQL, data and infra costs, I get all of it so I am able to catch these mofos when they are about to stab me in the back but man! my productivity is through the roof. And I am loving it. Just so I can avoid saying I cannot tell you I am working on, I will start something that I can share soon (as soon as decades of pent up work is done, its probably less than a few months away!). Take it with a grain of salt, and know this, these things are not your friends, they WILL stab you in the back when you least expect them, cut a corner, take a short cut, so you have to be the PHB (dilbert reference!) with actual experience to catch them slacking. Good luck.
- exabrial 8mo agoAfter using Anthropic's products, I think it's going to be difficult to go back to OpenAI. It feels more like a discussion with a peer; ChatGPT has always felt like arguing with an idiot on Reddit.
- replwoacause 8mo agoI agree the tone is better on Claude but the limits suck on the Pro plan.
- exabrial 8mo agoAgree completely. Looking at OpenAIs public financials, Anthropic is likely exposing the true cost, where OpenAI is incinerating unlimited cash for users. I think eventually companies will have the consumers foot the power bill somehow (local models?). No idea.
- energy123 8mo agoFirst impression: It's much faster for the same task. When they hook it up to Cerebras it's going to be a head-exploding moment.
- EZ-E 8mo agoCan someone explain the difference between this and VSCode agent chat? Except the fact that it's a separate app?
- gverrilla 8mo agoVsCode = IDE Codex/Claude Code = TUI
- cheriot 8mo agoPage me when codex can run the right version of node. Are we all changing the system node version to match the current project again? [shell_environment_policy] inherit = "all" experimental_use_profile = true [shell_environment_policy.set] NVM_DIR = "[redacted]" PATH = "[redacted]"
- smarx007 8mo agoBoth Claude and Gemini (the web variants, not CLI) tried to downgrade my .NET 10 projects to .NET 9 at least a few times.
- maxkfranz 8mo agoIt worked for me after I configured mise. I needed the mise setup in both `.zprofile` and `.zshrc` for Codex to pick it up. I think mise sets up itself in one of those by default, but Codex uses the other. I expect the same problem would present itself with nvm. I.e. `eval "$(/Users/max/.local/bin/mise activate zsh)"` in `.zprofile` and `.zshrc` Then Codex will respect whatever node you've set as default, e.g.: mise install node@24 mise use -g node@24 Codex might respect your project-local `.nvmrc` or `mise.toml` with this setup, but I'm not certain. I was just happy to get Codex to not use a version of node installed by brew (as a dependency of some other package).
- cheriot 8mo agoThanks! I moved my PATH setup to .zprofile and everything works now. Brew had added itself to .zprofile and everything else was in .zshrc.
- maxkfranz 8mo agoGlad it worked out. And I agree it’s annoying that this doesn’t just work out of the box. It’s not like node/nvm are uncommon, so you’d think they would have ran into the issue when using their own tool.
- Sn0wCoder 8mo agoIf you are already using Volta in your project Codex will use the correct version assuming you are running in the same directory as your .json file and the json file has the” volta”:{ “node”: “xx.x.x”, “npm”: “xx.x.x”} configured. Personally use a Dockerfile to setup the container with volta installed. Need to set up Volta and configure at least one version of Node then install Codex in the docker. One caveat is you need to update codex with the initial version of node assuming it’s not the same as your project. If you are using one image per project you should never run into this but I have been using one image and firing up a container for each project, so it was great to see Codex able to use the correct version configured for the project via Volta. From other comments sounds like Codex using mise for internal tools can cause issues but not sure that is 100% Codex fault if the project is not already defining the node/npm version in the json “engines” entry. If it’s ignoring that entry then I guess this is a valid complaint, but not sure how Codex is supposed to guess which version of tools to use for different projects. Would you mind adding more details as to the exact setup where Codex is using the wrong version?
- ksynwa 8mo agoWhy does OpenAI have a separate model for coding (Codex) but Anthropic uses the same model for chatbots and coding?
- zozbot234 8mo agoThey seem to be slowly moving away from having a separate coding model. With this release, they're calling the model Codex but expressly mention that it's also supposed to be more suitable than GPT 5.2 for general use.
- prng2021 8mo agoWhere did they say that?
- zozbot234 8mo ago"The model advances both the frontier coding performance of GPT‑5.2-Codex and the reasoning and professional knowledge capabilities of GPT‑5.2, together in one model, which is also 25% faster. ... With GPT‑5.3-Codex, Codex goes from an agent that can write and review code to an agent that can do nearly anything developers and professionals can do on a computer." They're specifically saying that they're planning for an overall improvement over the general-purpose GPT 5.2.
- sejje 8mo agoI remember a paper coming out a while back that said training the models to code made them much better at normal tasks. It improved their logic etc.
- netdevphoenix 8mo agoHow come that OpenAI and Anthropic both released their models pretty much at the same time? Does anyone know if the timing is coincidental?
- phil917 8mo agoI would bet to be ready before the Superbowl ads
- jstummbillig 8mo agoIt's so interesting that I start to feel a change, that is developing as a separate thing to capability. Previously, yeah sure, things changed but models got so outrageously better at the basic things that I simply wouldn't care. Now... increasingly it's like changing a partner just so slightly. I can feel that something is different and it gives me pause. That's probably not a sign of the improvement diminishing. Maybe more so my capability to appreciate them. I can see how one might get from here to the whole people being upset about 4o thing.
- aavci 8mo agoTo anyone trying this, does this unlock anything you tried to do with the past LLM models but failed and now you can try again? Do you find this as an incremental improvement or something that brings in new opportunities?
- aavci 8mo ago“our team was blown away by how much Codex was able to accelerate its own development.” At what point will LLMs be autonomously self creating new versions of themselves?
- nickandbro 8mo agoI have found GPT 5.3-Codex to do exceedingly well when working with graphics rendering pipelines. They must have better training data or RL approaches than Antropic as I have given the same prompt and config to Opus 4.6 and it seems to have added unwanted rendering artifacts. This may be just an issue specific to my use case, but wonder since OpenAI is partners with MSFT, which makes lots of games, that this may be an area they heavily invested in
- DrBazza 8mo agoIt took several decades for the language server protocol and debugger server protocol (or whatever it's called). Is there a common 'agent' protocol yet? Or are these companies still in the walled-garden phase?
- arcanemachiner 8mo agohttps://agentclientprotocol.com/get-started/introduction https://agentclientprotocol.com/get-started/introduction
- arjun810 8mo agoOur results on our rails app surprised us. Codex 5.3 far and away the best — much faster and cheaper (though cost isn’t relevant yet, since you can only access this model via a ChatGPT plan). https://x.com/sergeykarayev/status/2019541031986032925?s=46 https://x.com/sergeykarayev/status/2019541031986032925?s=46
- zen4ttitude 8mo agoDoes anyone know more about the benchmark? 60% accuracy gets a drumroll? How would Claude do? How would a human do? I tried the previous version and was not impressed. I went back to Claude that is very hard to beat, and versatile with context enrichment.
- 4corners4sides 8mo agoA 77% score on terminal-bench 2 is really impressive. I remember reading the article about the pi coding agent (https://mariozechner.at/posts/2025-11-30-pi-coding-agent/ https://mariozechner.at/posts/2025-11-30-pi-coding-agent/) getting into the top ten percent of agents on that benchmark. It got about 50%. While it may still be in the top ten, that category just turned into one champion and a long of inferior offerings. I was shocked to see that in the prompt for one of the landing pages the text “lavender to blue gradient” was included as if that’s something that anybody actually wants. It’s like going to the barber and saying “just make me look awful”. This was my first time actually seeing what the GDPval benchmark looked like. Essentially they benchmark for all the artifacts that HR/finance might make or work on (onboarding documents, accounting spreadsheets, powerpoint presentations .etc). I think it’s good that models are trained to generate things like this well since people are going to use AI to do such anyway. If the middlemen passing AI ouputs around are going to be lazy I’m grateful that at least OpenAI researchers are cooking something behind the scenes.
- proflead 8mo agoI've tested it and I think Codex is pretty good https://youtu.be/qsYcOn1fKIk?si=W06vQzO2R-62bZ_O https://youtu.be/qsYcOn1fKIk?si=W06vQzO2R-62bZ_O