3 ms·

We have spend caps at the billing account level and the project level (developer set) in the Gemini API now. There is up to a 10 minute delay in processing ever

We have spend caps at the billing account level and the project level (developer set) in the Gemini API now. There is up to a 10 minute delay in processing everything but this should significantly mitigate the risk here: https://ai.google.dev/gemini-api/docs/billing#tier-spend-caps https://ai.google.dev/gemini-api/docs/billing#tier-spend-cap... By default, new Tier 1 paid accounts can only spend $250 in a given month.

flippyhead 6mo ago
I'm sure it's me being an idiot, but once again I spent 20m trying to figure how to do a specific thing in google-land and still haven't figured it out. Even if I did set it somewhere, I see things like "Setting a budget does not cap resource or API consumption" with a link to a bunch of documentation I have to analyze.
- bdashdash 6mo ago
  This is what working with cloud services is like, in my experience. Azure's UI feels like it was made as a joke flash game on Newgrounds.
not_your_vase 6mo ago
I just find it extraordinary that the biggest tech company in the world can do cutting edge real time AI for millions of people, run Youtube and of course all the other google services with having literally the smartest people in the world and unlimited resources on board, but still can't keep real time track of the user's current billing and their spending limits, it's all best effort still. Somehow it doesn't add up. (Pun not intended, but I'm happy to have it)
- strangattractor 6mo ago
  If spending caps made them more money they'd find a way;)
- siva7 6mo ago
  Not just Google, also Microsoft and Amazon. Real-time cost tracking is technically impossible to solve according to the major cloud providers. I have huge respect for those sales & finops engineers.
  - Barbing 6mo ago
    Not just tech companies, telecommunications too. Poooooor AT&T, goodness it's hard to know how much data they just sent to us. Hard twenty years ago, just as hard today.
  - aisaasbuilder 5mo ago
    Technically impossible for them because real-time attribution cuts into margin. Config-layer tracking does not have that constraint. You do not need real-time billing data if you know from the agent config that it is going to explode before it runs. That is the distinction Traeco is built on. traeco.dev
yjftsjthsd-h 6mo ago
How much of a bill can you run up in 10 minutes?
- deleted 6mo ago
  [deleted]
- fireant 6mo ago
  €26,000 per the fine article

flippyhead 6mo ago

I'm sure it's me being an idiot, but once again I spent 20m trying to figure how to do a specific thing in google-land and still haven't figured it out. Even if I did set it somewhere, I see things like "Setting a budget does not cap resource or API consumption" with a link to a bunch of documentation I have to analyze.

bdashdash 6mo ago
This is what working with cloud services is like, in my experience. Azure's UI feels like it was made as a joke flash game on Newgrounds.

not_your_vase 6mo ago

I just find it extraordinary that the biggest tech company in the world can do cutting edge real time AI for millions of people, run Youtube and of course all the other google services with having literally the smartest people in the world and unlimited resources on board, but still can't keep real time track of the user's current billing and their spending limits, it's all best effort still. Somehow it doesn't add up. (Pun not intended, but I'm happy to have it)

strangattractor 6mo ago
If spending caps made them more money they'd find a way;)
siva7 6mo ago
Not just Google, also Microsoft and Amazon. Real-time cost tracking is technically impossible to solve according to the major cloud providers. I have huge respect for those sales & finops engineers.
- Barbing 6mo ago
  Not just tech companies, telecommunications too. Poooooor AT&T, goodness it's hard to know how much data they just sent to us. Hard twenty years ago, just as hard today.
- aisaasbuilder 5mo ago
  Technically impossible for them because real-time attribution cuts into margin. Config-layer tracking does not have that constraint. You do not need real-time billing data if you know from the agent config that it is going to explode before it runs. That is the distinction Traeco is built on. traeco.dev

yjftsjthsd-h 6mo ago

How much of a bill can you run up in 10 minutes?

deleted 6mo ago
[deleted]
fireant 6mo ago
€26,000 per the fine article