4 ms·

As someone dealing with billions of records on it, BigQuery is far from cheap; G will not charge you much for storage as they will charge you for queries and da

by dig1 2y ago

As someone dealing with billions of records on it, BigQuery is far from cheap; G will not charge you much for storage as they will charge you for queries and data transfer. AFAIK, the cheapest Postgres server on GCP is very expensive compared to the usual Postgres installation (price/performance).

michaelmior 2y ago
What do you mean by "the usual Postgres installation"?
renegade-otter 2y ago
That and RDS are kind of a rip-off if you are trying to have a sandbox out there, short of running your own instance. For that, I found Digital Ocean to be very reasonable.
- eastbound 2y ago
  DO’s pricing has increased a lot. I was surprised, I couldn’t start a $5 vm anymore, it’s worth checking again.
  - jmholla 2y ago
    You can, but I think you have to be in one of the regions that supports it. The generally (globally?) available lowest priced VM is $6 a month. https://www.digitalocean.com/pricing/droplets https://www.digitalocean.com/pricing/droplets
sgarland 2y ago
Yep. I used it once for a personal project involving GHTorrent [0], and each query was about $20. That may be peanuts for a business, but for someone playing around on their own, it's incredibly prohibitive. [0]: https://github.com/ghtorrent/ghtorrent.org/blob/master/gcloud.md https://github.com/ghtorrent/ghtorrent.org/blob/master/gclou...
- LorenzoGood 2y ago
  What is hardboiled studios?
- bhouston 2y ago
  On billions of records my query costs were generally less than a cent. But I partitioned and clustered on the key fields.
- chrisldgk 2y ago
  Either the website this is referring to got hacked or you sold it. Either way, this probably shouldn’t be linked on HN.
- sgarland 2y ago
  EDIT: The site no longer exists, it seems. The project (which is not my creation) was a regularly-updated dump of all GitHub metadata (PR comments, Issues, etc.). Here's an archive snapshot: https://web.archive.org/web/20220126060859/https://ghtorrent.org/ https://web.archive.org/web/20220126060859/https://ghtorrent...

by dig1 2y ago

michaelmior 2y ago

What do you mean by "the usual Postgres installation"?

renegade-otter 2y ago

That and RDS are kind of a rip-off if you are trying to have a sandbox out there, short of running your own instance. For that, I found Digital Ocean to be very reasonable.

eastbound 2y ago
DO’s pricing has increased a lot. I was surprised, I couldn’t start a $5 vm anymore, it’s worth checking again.
- jmholla 2y ago
  You can, but I think you have to be in one of the regions that supports it. The generally (globally?) available lowest priced VM is $6 a month. https://www.digitalocean.com/pricing/droplets https://www.digitalocean.com/pricing/droplets

sgarland 2y ago

Yep. I used it once for a personal project involving GHTorrent [0], and each query was about $20. That may be peanuts for a business, but for someone playing around on their own, it's incredibly prohibitive. [0]: https://github.com/ghtorrent/ghtorrent.org/blob/master/gcloud.md https://github.com/ghtorrent/ghtorrent.org/blob/master/gclou...

LorenzoGood 2y ago
What is hardboiled studios?
bhouston 2y ago
On billions of records my query costs were generally less than a cent. But I partitioned and clustered on the key fields.
chrisldgk 2y ago
Either the website this is referring to got hacked or you sold it. Either way, this probably shouldn’t be linked on HN.
sgarland 2y ago
EDIT: The site no longer exists, it seems. The project (which is not my creation) was a regularly-updated dump of all GitHub metadata (PR comments, Issues, etc.). Here's an archive snapshot: https://web.archive.org/web/20220126060859/https://ghtorrent.org/ https://web.archive.org/web/20220126060859/https://ghtorrent...