tedsanders

7 ms·

61.
by tedsanders 5mo ago
FYI, Elo isn't an acronym - it's a person's name. No need to capitalize it as ELO.
62.
Get 2 months of Codex for your enterprise, free(openai.com)
2 points by tedsanders 5mo ago|0 comments
63.
Tau-knowledge: benchmarking agents on real-world knowledge(sierra.ai)
2 points by tedsanders 5mo ago|0 comments
64.
Mythos for Offensive Security: XBOW's Evaluation(xbow.com)
2 points by tedsanders 5mo ago|0 comments
65.
by tedsanders 5mo ago
Very cool! The demos felt fairly contrived - e.g., count things while I talk. I wonder what more useful or commercial applications look like.
66.
by tedsanders 5mo ago
To clarify the title, Daybreak is not a new AI model or a new product. It's a rebranding of OpenAI for Cyber, which is an umbrella over multiple things that OpenAI is doing with companies.
67.
by tedsanders 5mo ago
Dec 2025, actually: https://developers.openai.com/api/docs/models/gpt-5.5 (though knowledge cutoffs in practice can be bit fuzzy)
68.
by tedsanders 6mo ago
Whether a problem is "good" or "bad" is not always objective or simple. For example, you can have problems that are underspecified, with hardcoded tests for a particular solution (out of multiple possible solutions). If
69.
by tedsanders 6mo ago
We don't want hallucinations either, I promise you. A few biased defenses: - I'll note that this eval doesn't have web search enabled, but we train our models to use web search in ChatGPT, Codex, and our API. I'd be curi
70.
by tedsanders 6mo ago
Honest answer is that it isn't done running yet. It takes some human bandwidth and time to run, so results weren't ready by this morning. We don't know what the score will be, but will probably go up on the leaderboard someti
71.
by tedsanders 6mo ago
Agreed. Would be great if everyone starts reporting cost per task alongside eval scores, especially in a world where you can spend arbitrary test-time compute. This is one thing I like about the Artificial Analysis website - they include co
72.
by tedsanders 6mo ago
Yep, it's more expensive per token. However, I do want to emphasize that this is per token, not per task. If we look at Opus 4.7, it uses smaller tokens (1-1.35x more than Opus 4.6) and it was also trained to think longer. https:&#x2F
73.
by tedsanders 6mo ago
Not this time, no.
74.
by tedsanders 6mo ago
Just as a heads up, even though GPT-5.5 is releasing today, the rollout in ChatGPT and Codex will be gradual over many hours so that we can make sure service remains stable for everyone (same as our previous launches). You may not see it ri
75.
by tedsanders 6mo ago
> Meanwhile, everyone can read the news about layoffs attributed to AI and can see that hiring (especially of junior engineers) has slowed to a trickle. According to FRED/Indeed[1], software job openings have been roughly flat for 2
76.
by tedsanders 6mo ago
Following up - I was wrong about 10x/40x. Here's how it actually works: $20 = 1x $100 = 5X (but temporarily 10x for just Codex til May 31st) $200 = 20x We'll send out new tweets and clarify our pricing page.
77.
by tedsanders 6mo ago
> I remember the gpt-5 benchmarks and how wildly inaccurate they were data-wise. Linking one[0] that I found so that other people can remember what I am talking about. I remember some data being completely misleading or some reaching mor
78.
by tedsanders 6mo ago
I work at OpenAI and I really don't find this to be the case. We're pretty diligent about applying search blocklists, closing hacking loopholes, and reading model outputs to catch unanticipated hacks. If we wanted to, we could cho
79.
by tedsanders 6mo ago
I'm honestly not sure, as I don't work on it. My understanding from afar is: - There was a 2x promotion in March that ended on April 2, so limits have felt tighter since then - We sometimes reset rate limits after bugs or mileston
80.
by tedsanders 6mo ago
All good, I interpreted it as postulation and not accusation. :) I do like the job! Much more organic than yanking tickets, though I'm on the model training side of things, rather than product side. Always a balance between short-term
81.
by tedsanders 6mo ago
Nope, it's just that a lot of people (especially those using Codex) asked us for a medium-sized $100 plan. $20 felt too restrictive and $200 felt like a big jump. Pricing strategy is always a bit of an art, without a perfect optimum fo
82.
by tedsanders 7mo ago
For what it's worth, the big AI companies do have opt out mechanisms for scraping and search. OpenAI documents how to opt out of scraping here: https://developers.openai.com/api/docs/bots Anthropic documents
83.
by tedsanders 7mo ago
It's documented here: https://developers.openai.com/api/docs/bots
84.
by tedsanders 7mo ago
I work at OpenAI. Software developers are not obsoleted by Codex or Claude Code, nor will they be soon. For our teams, Codex is a massive productivity booster that actually increases the value of each dev. If you check our hiring page, you’
85.
by tedsanders 7mo ago
In the text, we did share one hallucination benchmark: Claim-level errors fell by 33% and responses with an error fell by 18%, on a set of error-prone ChatGPT prompts we collected (though of course the rate will vary a lot across different
86.
by tedsanders 7mo ago
Yeah, long context vs compaction is always an interesting tradeoff. More information isn't always better for LLMs, as each token adds distraction, cost, and latency. There's no single optimum for all use cases. For Codex, we'
87.
by tedsanders 8mo ago
Yeah, for a while ChatGPT Plus has been powered by two series of models under the hood. One series is the Instant series, which is faster and more tuned to ChatGPT, but less accurate. The second series is the Thinking series, which is more
88.
by tedsanders 8mo ago
The supply chain risk stuff is bogus. Anthropic is a great, trustworthy company, and no enemy of America. I genuinely root for Anthropic, because its success benefits consumers and all the charities that Anthropic employees have pledged equ
89.
by tedsanders 8mo ago
I agree it makes little sense, and I think if all players were rational it never would have played out this way. My understanding is that there are other reasons (i.e., beyond differing red lines) that made the OpenAI deal more palatable, b
90.
by tedsanders 8mo ago
I'm an OpenAI employee and I'll go out on a limb with a public comment. I agree AI shouldn't be used for mass surveillance or autonomous weapons. I also think Anthropic has been treated terribly and has acted admirably. My un

More ›