3 ms·
This price drop is significant. For <128,000 tokens they're dropping from $3.50/million to $1.25/million, and output from $10.50/million to $2.50/million. For
by simonw 2y ago
This price drop is significant. For <128,000 tokens they're dropping from $3.50/million to $1.25/million, and output from $10.50/million to $2.50/million.
For comparison, GPT-4o is currently $5/million input and $15/million output and Claude 3.5 Sonnet is $3/million input and $15/million output.
Gemini 1.5 Pro was already the cheapest of the frontier models and now it's even cheaper.
- GaggiX 2y agoGPT-4o is 2.5/10$. Unless you look at an old checkpoint. GPT-4o was the cheapest frontier model before.
- simonw 2y agoI can’t see that price on https://openai.com/api/pricing/ https://openai.com/api/pricing/ - it’s listing $5/m input and $15/m output for GPT-4o right now. No wait, correction: That’s confusing: it lists 4o first and then lists gpt-4o-2024-08-06 as $2.50/$10.
- jeffharris 2y agoapologies: it's taken us a minute to switch the default `gpt-4o` pointer to the newest snapshot we're planning on doing that default change next week (October 2nd). And you can get the lower prices now (and the structured outputs feature) by manually specify `gpt-4o-2024-08-06`
- jiggawatts 2y ago> “You can” No, “I” can’t. Open AI has always trickled out model access, putting their customers into “tiers” of access. I’m not sufficiently blessed by the great Sam to have immediate access. On, and Azure Open AI especially likes to drag their feet both consistently, and also on a per-region basis. I live in a “no model for you” region. Open AI says: “Wait your turn, peasant” while claiming to be about democratising access. Google and everyone else just gives access, no gatekeeping.
- benterix 2y ago> Google and everyone else just gives access, no gatekeeping. Well, Gemini Pro was delayed in Europe for many months. Same for Claude.
- jiggawatts 2y agoFor legal/regulatory reasons, not for the arbitrary favouritism reasons of OpenAI.
- RhodesianHunter 2y agoI wonder if they're pulling the wall-mart model. Ruthlessly cut costs and sell at-or-below costs until your competitors go out of business, then ratchet up the prices once you have market dominance.
- entropicdrifter 2y agoYou think Google would engage in monopolistic practices like that? Because I do
- 0cf8612b2e1e 2y agoI have no idea if this is dumping or not. At Microsoft/Google scale, what does it cost to serve a million LLM tokens? Tough to disentangle the capex vs opex costs for them. If they did not have so many other revenue streams, potentially dicey as there are probably still many untapped performance optimizations.
- bko 2y agoIsn't Walmart still incredibly cheap? They have a net margin of 2.3% I think that's one of those things competitors complain about that never actually happens (the raising prices part). https://www.macrotrends.net/stocks/charts/WMT/walmart/net-profit-margin https://www.macrotrends.net/stocks/charts/WMT/walmart/net-pr...
- lacker 2y agoProbably not. Do they really believe they are going to knock OpenAI out of business, when the OpenAI models are better? Instead I think they are going after the "Android model". Recognize they might not be able to dethrone the leader who invented the space. Define yourself in the marketplace as the cheaper alternative. "Less good but almost as good." In the end, they hope to be one of a small number of surviving members of an valuable oligopoly.
- GaggiX 2y agoAndroid is more popular than iOS by a large margin and it's neither less good or cheaper, it really depends on the smartphone.
- pzo 2y agowhats confusing they have different pricing for output. Here [1] it's $5/million output (starting 1st october) and on vertex AI [2] it's $2.5/1 million (starting 7 october) - but characters - so it's overall gonna be more expensive if you wanna compare to equivalent 1 million tokens. It's actually even more confusing to know what kind of characters they mean? 1 byte? UTF-8? [1] https://ai.google.dev/pricing https://ai.google.dev/pricing [2] https://cloud.google.com/vertex-ai/generative-ai/pricing https://cloud.google.com/vertex-ai/generative-ai/pricing
- Deathmax 2y agoThey do mention how characters are counted in the Vertex AI pricing docs: "Characters are counted by UTF-8 code points and white space is excluded from the count"
- monsieurpooh 2y agoThey CHANGED the pricing for the first link; originally the output said price drop from $10.50 to $2.50 but now it says $10.50 to $5.00.
- lossolo 2y ago> For comparison, GPT-4o is currently $5/million input and $15/million output and Claude 3.5 Sonnet is $3/million input and $15/million output. Google is the only one of the three that has its own data centers and custom inference hardware (TPU).
- ekkk 2y agoIt doesn't matter if it's cheap, it's unusable.
- copperx 2y agoCan you expound on why do you find it unusable?
- monsieurpooh 2y agoThey CHANGED the pricing from $2.50 to $5.00 stealthily unannounced. Look at the web site again; it says $5 per million now, and this comment on this website might be the ONLY evidence in the world that I wasn't gaslighting myself or hallucinating!