4 ms·

They have a documentation page titled “Avoid surprise bills”[1] but I imagine it’s easy for some developers to skip over that. [1]: https://firebase.google.com

They have a documentation page titled “Avoid surprise bills”[1] but I imagine it’s easy for some developers to skip over that. [1]: https://firebase.google.com/docs/projects/billing/avoid-surprise-bills https://firebase.google.com/docs/projects/billing/avoid-surp...

unsnap_biceps 2y ago
https://firebase.google.com/docs/projects/billing/avoid-surprise-bills https://firebase.google.com/docs/projects/billing/avoid-surp... > We don't turn off services and usage because although you might have a bug in your app causing an increase in spend, you might just be experiencing unexpected positive growth of your app. You don't want your app to shut down unexpectedly when you need it to work the most. Frankly, I don't see anything on that page that would actually prevent a surprise bill.
jsheard 2y ago
> A budget alert sends an email whenever your project's spending level hits a threshold that you've set. Budget alerts do NOT turn off services or usage for your app. It's not an automatic hard-stop so you could still screw yourself over pretty badly with runaway spending.
rezokun 2y ago
eg. OpenAI enforces strict limits until you spend a significant amount of money.
- mason55 2y ago
  My guess is that OpenAI’s margins are much lower so they aren’t in a position to forgive or have people skip out on big bills. For Firebase, their costs are probably pretty marginal.
- falcor84 2y ago
  From my experience, cloud LLMs are still being used by most systems as an "additional feature" with fallback to alternative basic functionality, or some other form of graceful degradation. On the other hand, there typically isn't a good fallback to having your main DB go down.
- jasongill 2y ago
  Once you do spend a significant amount of money, you'll find that the limits you can set yourself might not even work. We have a multi-organization OpenAI account and I had set a $4k/month limit on one of the child orgs that was being used for a R&D project. Got billed ~$20k for the project one month and complained that it clearly allowed us to exceed our soft and hard limits. We were told that the limits (which you can set and act like they are a real thing) don't do anything if you have a child organization set up. They refunded us after some persuading and I know it's just normal growing pains for an organization that is undergoing rapid growth and maturity, but was still a little surprising that even the "hard limit" didn't do anything for us! (Note that this was last year, so this bug is probably long fixed as they have redesigned their portal multiple times now)
- danpalmer 2y ago
  OpenAI functionally have one API, it's easy to limit spend on one API. It's much less easy to limit spend across hundreds of APIs, and resources that have ongoing cost (like VM hours).

unsnap_biceps 2y ago

https://firebase.google.com/docs/projects/billing/avoid-surprise-bills https://firebase.google.com/docs/projects/billing/avoid-surp... > We don't turn off services and usage because although you might have a bug in your app causing an increase in spend, you might just be experiencing unexpected positive growth of your app. You don't want your app to shut down unexpectedly when you need it to work the most. Frankly, I don't see anything on that page that would actually prevent a surprise bill.

jsheard 2y ago

> A budget alert sends an email whenever your project's spending level hits a threshold that you've set. Budget alerts do NOT turn off services or usage for your app. It's not an automatic hard-stop so you could still screw yourself over pretty badly with runaway spending.

rezokun 2y ago

eg. OpenAI enforces strict limits until you spend a significant amount of money.

mason55 2y ago
My guess is that OpenAI’s margins are much lower so they aren’t in a position to forgive or have people skip out on big bills. For Firebase, their costs are probably pretty marginal.
falcor84 2y ago
From my experience, cloud LLMs are still being used by most systems as an "additional feature" with fallback to alternative basic functionality, or some other form of graceful degradation. On the other hand, there typically isn't a good fallback to having your main DB go down.
jasongill 2y ago
Once you do spend a significant amount of money, you'll find that the limits you can set yourself might not even work. We have a multi-organization OpenAI account and I had set a $4k/month limit on one of the child orgs that was being used for a R&D project. Got billed ~$20k for the project one month and complained that it clearly allowed us to exceed our soft and hard limits. We were told that the limits (which you can set and act like they are a real thing) don't do anything if you have a child organization set up. They refunded us after some persuading and I know it's just normal growing pains for an organization that is undergoing rapid growth and maturity, but was still a little surprising that even the "hard limit" didn't do anything for us! (Note that this was last year, so this bug is probably long fixed as they have redesigned their portal multiple times now)
danpalmer 2y ago
OpenAI functionally have one API, it's easy to limit spend on one API. It's much less easy to limit spend across hundreds of APIs, and resources that have ongoing cost (like VM hours).