3 ms·
BigQuery has two unusual technical features that make it uniquely suited to hosting public data like this: 1. It has a separate "storage tier" and "compute tie
by georgewfraser 10y ago
BigQuery has two unusual technical features that make it uniquely suited to hosting public data like this:
1. It has a separate "storage tier" and "compute tier", so we can all run queries against the same dataset at the same time.
2. The "compute tier" is 100% shared, so I can use BigQuery even if I just want to run a few queries.
I hope we'll see more projects like this. Having public data available in SQL is a great thing. SQL is easy enough that a lot of people can figure it out, but powerful enough to do real work.
- vgt 10y agoRight on! Check out this as well: https://cloud.google.com/bigquery/public-data/ https://cloud.google.com/bigquery/public-data/ https://www.reddit.com/r/bigquery/wiki/datasets https://www.reddit.com/r/bigquery/wiki/datasets
- deinmachine 10y agoAlso check out http://government-contracts.insidegov.com/ http://government-contracts.insidegov.com/ and http://government-contractors.insidegov.com/ http://government-contractors.insidegov.com/. Data is slightly outdated, but is being updated as we speak to account for the recent changes USASpending.gov made to their file schema. We did work to tie in all subsidiaries and branches into summary profiles through Duns numbers to give a true estimate for the obligated contract amount won by large corporations. Thanks for posting the other sites with this data, always great to check out how others handle these problems! Full disclosure, I work for Graphiq which owns InsideGov.
- manigandham 10y agoDo you have an email you can share? I'm at manigandham @ gmail. We're looking to move to GCP and love what's there so far but need some help from the startup side.
- vgt 10y agotweet at me @thetinot