vgt

27 ms·

1. 241.▲
   by vgt 10y ago

   It's a sign of changing times indeed, but for the consumer's benefit. It is absolutely in Google's best interests to externalize security for its customers as a differentiator of Google Cloud. The parent article itself links
2. 242.▲
   Continuous Deployment to Google Cloud Platform with Drone(open.blogs.nytimes.com)

   1 points by vgt 10y ago|0 comments
3. 243.▲
   Finding the sentiment-analysis signal in the noise with Google Cloud Dataflow(cloud.google.com)

   2 points by vgt 10y ago|0 comments
4. 244.▲
   The Apache Software Foundation Announces Apache Beam as a Top-Level Project(blogs.apache.org)

   4 points by vgt 10y ago|0 comments
5. 245.▲
   A Hadoop cluster becomes a means to an end for job execution(hackernoon.com)

   1 points by vgt 10y ago|0 comments
6. 246.▲
   On ephemeral Hadoop and Spark clusters(medium.com)

   2 points by vgt 10y ago|0 comments
7. 247.▲
   by vgt 10y ago

   Author here, work at Google Cloud. These are ephemeral instances, so you should use them for workloads that can be easily interrupted, saved, resumed, and restarted elsewhere. - In the blog I mention that Dataproc, Google's Hadoop+Spar
8. 248.▲
   by vgt 10y ago

   Your post has motivated me to blog some details about the difference between AWS EC2 Spot Instances and Google Cloud's Preemptible VMs: https://medium.com/@thetinot/google-clouds-spot-instances-wi... (work at Goog
9. 249.▲
   Google's Spot Instances win big and you should too(medium.com)

   2 points by vgt 10y ago|2 comments
10. 250.▲
    by vgt 10y ago

    One more comment on storage. Google Cloud storage has the same API for all its tiers. So to go from Multi-Region to Nearline, you just change the bucket designation. One API, one service, one interface and set of tools. (work on Google Clou
11. 251.▲
    by vgt 10y ago

    I'll add that the main issue seems to be with Google AppEngine of two years ago. For compute options Google Cloud has Compute Engine, Container Engine (Kubernetes), and even AppEngine Flex Environment these days. (work at Google Cloud)
12. 252.▲
    by vgt 10y ago

    I hear ya. Check out the postmortem for the BigQuery Streaming API outage [0]. Relevant paragraph: "Finally, we have received feedback that our communications during the outage left a lot to be desired. We agree with this feedback. Whi
13. 253.▲
    by vgt 10y ago

    Some more: [0] https://cloud.google.com/blog/big-data/2016/01/anatomy-of-a-... [1] https://cloud.google.com/blog/big-data/2016/08/google-bigque... [2] https:/&#
14. 254.▲
    by vgt 10y ago

    Great to hear from a happy customer! Some more color commentary: - Quotas can be a little annoying indeed, but they're generally there for a reason. Over time, we've moved BigQuery in direction of having less and less quotas in ge
15. 255.▲
    by vgt 10y ago

    feel free to pm me.
16. 256.▲
    by vgt 10y ago

    Google BigQuery has pure separation of storage and compute, which allows for Public Datasets [0] to exist in ready-to-query highly optimized format. Run SQL immediately! BigQuery has a perpetual free query tier of 1 Terabyte per month ($5).
17. 257.▲
    You Can Now Play with Stack Overflow Data on Google’s BigQuery(stackoverflow.blog)

    1 points by vgt 10y ago|0 comments
18. 258.▲
    How BigQuery's data ingest breaks tech norms(medium.com)

    2 points by vgt 10y ago|0 comments
19. 259.▲
    by vgt 10y ago

    Hey there, I work on Google Cloud. Did you set a billing alert? Google BigQuery has proactive "cost controls" that won't let you go overboard, whereas billing alerts are just that - alerts.
20. 260.▲
    by vgt 10y ago

    Google has a "Glacier vs Nearline" calculator, which doesn't appear to have been updated yet: https://cloud.google.com/pricing/tco/storage-nearline (work at Google)
21. 261.▲
    Google Acquires learning platform Qwiklabs(zdnet.com)

    3 points by vgt 10y ago|0 comments
22. 262.▲
    by vgt 10y ago

    I don't think there's an equivalent to Bigtable anywhere. It's so badass it's not even funny - take a look at [0] - a small team of engineers took O(weeks) to build a system that clocks 56 million qps (and these aren&#x2
23. 263.▲
    by vgt 10y ago

    lol!
24. 264.▲
    by vgt 10y ago

    Great comments! Another way to look at Dataflow pricing as it related to this type of technology. Let's just assume for a second Dataflow and other similar technologies execute your pipeline on your data within the same resource-time a
25. 265.▲
    by vgt 10y ago

    Yeah that's reasonable. At Google Cloud "Beta" means very far down the line of maturity. But YMMV and buyer beware when using "Beta" for production at any provider.
26. 266.▲
    by vgt 10y ago

    That makes sense. Please feel free to engage me here or offline - happy to introduce you to the right folks for this discussion.
27. 267.▲
    by vgt 10y ago

    I try to engage in dialogue, reach folks, provide factual information, and gather feedback on how we can do better. I offer folks to contact me directly. I also try to make it very clear who my employer is, through either direct note or cle
28. 268.▲
    by vgt 10y ago

    I hear you, this is all good feedback.
29. 269.▲
    by vgt 10y ago

    I'm actually offering direct dialogue. A few folks emailed me already, and I encourage you to as well. This is my idea of a peaceful Sunday:)
30. 270.▲
    by vgt 10y ago

    Thanks for your feedback!