vgt

13 ms·

151.
Google not Amazon. Make fantastic savings in a server-less world(in.3wks.com.au)
25 points by vgt 9y ago|23 comments
152.
by vgt 9y ago
Can you please elaborate on why you think BigQuery's streaming inserts are not particularly reliable? Separately, you can always use BigQuery's federated query capability of Bigtable. (work at G)
153.
by vgt 9y ago
To add to Boulos point - Google Cloud has the "Cloud Transfer Service" [0] that's hugely popular. It's easy to get connectivity to Google's vast network of POPS and this service helps take advantage of that connecti
154.
There are very few suitable use cases for DynamoDB(syslog.ravelin.com)
232 points by vgt 9y ago|140 comments
155.
Speeding up queries with HyperLogLog++(cloud.google.com)
2 points by vgt 9y ago|0 comments
156.
by vgt 9y ago
yea I think within the context of BigQuery the most sensible thing would be to do an aggregate per the column that would be considered a primary key. For example [0]. That said, Streaming API de-dupe window is very nice in practice. I menti
157.
by vgt 9y ago
Qubit's strategy to do this via streaming, leveraging Google Cloud Dataflow: https://cloud.google.com/blog/big-data/2017/06/how-qubit-ded...
158.
Introducing the Video Intelligence API(cloud.google.com)
1 points by vgt 9y ago|0 comments
159.
by vgt 9y ago
While Spanner has only been available to be used outside of Google very recently (GA in May), it's been in production at Google across hundreds of products, including AdWords, since 2012.. with global consistency to boot... (work at G)
160.
In-Memory Shuffle in Google Cloud Dataflow(cloud.google.com)
2 points by vgt 9y ago|0 comments
161.
Deduplication of streaming data at scale(cloud.google.com)
2 points by vgt 9y ago|0 comments
162.
by vgt 9y ago
Google's backbone is a little bit different. Google Cloud shares this backbone with Youtube, Maps, and the rest. Not only are there DC-to-DC cables, our backbone extends to a vast number of Edge POPS (more than AWS and Azure combined),
163.
by vgt 9y ago
Congrats Snowflake, this is a nice feature that takes advantage of pure separation of storage and compute. Google BigQuery has had this feature since 2012, and to see this in action take a look at Google's Public Datasets [0]. Only dif
164.
by vgt 9y ago
Googler here. I apologize if you had a bad experience with Google support. We've had various tiers of support, all the way up to dedicated engineers. Can you please share your viewpoint here, or your experiences?
165.
by vgt 9y ago
Shoot me a note, we'll sort it out
166.
New York Times Opens Up Comments with Google-Backed AI(fortune.com)
2 points by vgt 9y ago|0 comments
167.
by vgt 9y ago
A not on Google Cloud Public Datasets: - Public Datasets are updated almost weekly these days [0] - They are hosted in Google BigQuery storage immediately accessible by Standard SQL and easily joined against other public or private datasets
168.
Google Cloud Public Datasets now hosts EPA and OpenAQ air quality data(cloud.google.com)
115 points by vgt 9y ago|5 comments
169.
by vgt 9y ago
Good question! You probably are familiar with the bandwidth and throughput power of the underlying storage system of GCS, Colossus, through use of BigQuery. BigQuery Storage and GCS storage both leverage Colossus. It's silly fast :) Ot
170.
by vgt 9y ago
There is a per-core surcharge of basically $0.01 per hour [9]. And sadly Dataproc doesn't have a good autoscaling story. On the flip side, you can use Preemptible VMs for Dataproc, which are 80% off, and Dataflow has an amazing auto-sc
171.
by vgt 9y ago
Co-Author of the blog here. Awesome stuff, glad to see folks leveraging the possibilities! Perhaps as a follow-up you could write a guest blog on how this works for you! Feel free to ping me offline.
172.
Job-Scoped Hadoop Clusters with Google Cloud(cloud.google.com)
65 points by vgt 9y ago|19 comments
173.
by vgt 9y ago
Thanks for the feedback! I'd love to get more detail on your experiences so that we can iterate and improve and would be eternally thankful if you emailed me.
174.
by vgt 9y ago
Mandatory shameless plug - Google Sheets integrates with Google BigQuery. You can: - Query data in Google Sheets from BigQuery - Create virtual views in BigQuery that are powered by Google Sheets - One-click export data from BigQuery to Goo
175.
Life of a BigQuery Streaming insert(cloud.google.com)
2 points by vgt 9y ago|2 comments
176.
by vgt 9y ago
Shameless pitch: Google BigQuery has a 10GB free storage tier and a 1TB per month query tier. If your data is small enough, you get a fully managed "serverless" analytics database for very little, potentially free. (work at G)
177.
by vgt 9y ago
Google rolling its own hardware is a key security pillar. This is a good read on the topic: https://cloud.google.com/security/whitepaper (work at G)
178.
Google BigQuery announces perpetual free storage tier(cloud.google.com)
1 points by vgt 9y ago|0 comments
179.
by vgt 9y ago
I appreciate your passion. My argument isn't that Google doesn't shut down B2B services. It's that I have seen no evidence that Google does it at a vastly outlying rate relative to the industry. IANAL, but Both AWS [0] and Az
180.
by vgt 9y ago
I agree wholeheartedly. My argument is that there is not sufficient evidence to claim that "Google shuts things down nilly-willy" within the context of B2B (conflation with B2C is the real issue here). Rational thinkers should be

More ›