3 ms·
Tangential, but I've only heard about BigQuery from people being surprised with gargantuan bills for running one query on a public dataset. Is there a "safe" wa
by breakingcups 1y ago
Tangential, but I've only heard about BigQuery from people being surprised with gargantuan bills for running one query on a public dataset. Is there a "safe" way to use it with a cost limit, for example?
- abxyz 1y agoYes you can set price caps. The cost of a query is understandable ahead of time with the default pricing model ($6 per TB of data processed in a query). People usually get caught out by running expensive queries recursively. BigQuery is very cost effective and can be used safely.
- Aeolun 1y agoRunning ripgrep on my harddrive would cost me $48 at that price point.
- Symbiote 1y agoBigQuery data is stored (I assume) in column oriented files with indices, so a typical query reads only a tiny fraction of the stored data.
- Bratmon 1y agoYou can tell someone has worked in the cloud for too long when they start to think of $6 per database query as a reasonable price.
- morcus 1y agoSurely most queries should process much less than 1 TB of data?
- abxyz 1y agoMy 3TB, 41 billion row table costs pennies to query day to day. The billing is based on the data processed by the query, not the table size. I pay more for storage.
- lenkite 1y agoWe really need to go back to on-premise. We have surrendered our autonomy to these megacorps and now are paying for it - quite literally in many cases.
- deleted 1y ago[deleted]
- bangaladore 1y agoCan you actually set "price caps"? Most of the cloud services allow you to set alerts that are notorious for showing up after you've accidentally spend 50k USD. So even if you had a system that automated shutdown of services when getting the alert, you are SOL.