3 ms·
> Output: $10 / 1M tokens It's interesting that they're using flat token pricing for a "model" that is explicitly made of (at least) two underlying models, one
by addaon 1y ago
> Output: $10 / 1M tokens
It's interesting that they're using flat token pricing for a "model" that is explicitly made of (at least) two underlying models, one with much lower compute costs than the other; and with use ability to at least influence (via prompt) if not choose which model is being used. I have to assume this pricing model is based on a predicted split between how often the underlying models get used; I wonder if that will hold up, if users will instead try to rouse the better model into action more than expected, or if the pricing is so padded that it doesn't matter.
- simianwords 1y ago> that is explicitly made of (at least) two underlying models what do you mean?
- addaon 1y ago> a smart and fast model that answers most questions, a deeper reasoning model for harder problems, and a real-time router that quickly decides which model to use based on conversation type, complexity, tool needs, and explicit intent (for example, if you say “think hard about this” in the prompt). From https://openai.com/index/gpt-5-system-card/ https://openai.com/index/gpt-5-system-card/
- tedsanders 1y agoIn the API, there’s no router. Developers just pick whether they use the reasoning model or non-thinking ChatGPT model.
- mkozlows 1y agoThat's how the browser-based ChatGPT works, but not the API.