vgt

12 ms·

1. 91.▲
   by vgt 4y ago

   I am amazed at the velocity any Tesla criticism goes grey on social media.
2. 92.▲
   About Those Data Warehouse Performance Wars(firebolt.io)

   1 points by vgt 5y ago|0 comments
3. 93.▲
   by vgt 5y ago

   I think Snowflake cultivates a very careful public image, but in private their sales people use.. how do you say.. aggressive techniques.. databricks is addressing the source of market confusion head-on
4. 94.▲
   by vgt 7y ago

   Yes!!!! I wrote some words just on this topic recently!! https://medium.com/@vtereshko/data-warehouse-storage-or-a-da... (Pm on BigQuery)
5. 95.▲
   by vgt 7y ago

   If that is your jam, check out BigQuery' ML in SQL
6. 96.▲
   Autonomous Re-Clustering in Google BigQuery(cloud.google.com)

   1 points by vgt 7y ago|0 comments
7. 97.▲
   by vgt 7y ago

   We've improved our floor latency by a factor of 5 since two years ago, we've introduced clustering, and newly introduced BI engine gets you into dozen digit millisecond range, so give it a try again :) (Product manager on BigQuery
8. 98.▲
   ZetaSQL – Open Sourcing BigQuery's SQL(github.com)

   3 points by vgt 7y ago|0 comments
9. 99.▲
   by vgt 8y ago

   Check out the newly announced data fusion
10. 100.▲
    by vgt 8y ago

    BigQuery PM here. Nice work! Here's a recently built Graphite connector as well: https://twitter.com/vadimska/status/1112816503055843330
11. 101.▲
    The BigQuery sandbox(cloud.google.com)

    1 points by vgt 8y ago|0 comments
12. 102.▲
    by vgt 8y ago

    Geospatial for BigQuery just went Beta: https://cloud.google.com/bigquery/docs/gis-intro
13. 103.▲
    Geospatial types and queries in BigQuery(cloud.google.com)

    2 points by vgt 8y ago|0 comments
14. 104.▲
    by vgt 8y ago

    noted :)
15. 105.▲
    by vgt 8y ago

    (and clustering in BQ! [0]) [0] https://cloud.google.com/bigquery/docs/clustered-tables
16. 106.▲
    by vgt 8y ago

    Great post! A couple of thoughts: 1. It'd be interesting to see these benchmarks "under real-world adversity". For example, as data is ingested into the DW, as data shapes change, as concurrency of workloads varies. 2. It&#x2
17. 107.▲
    by vgt 8y ago

    Did you guys implement cluster keys in BigQuery as well? (BQ PM)
18. 108.▲
    by vgt 8y ago

    This video gives a walkthrough of the new version of Dremel that's been running in production for past 3 years (no paper sorry!): https://www.youtube.com/watch?v=UueWySREWvk
19. 109.▲
    by vgt 8y ago

    I'd love to hear your feedback, so yes please :) Anything you don't like is an opportunity to make our product better
20. 110.▲
    by vgt 8y ago

    Please don't hesitate to reach out for follow ups
21. 111.▲
    by vgt 8y ago

    I second Felipe's comment. Shoot me a note.
22. 112.▲
    by vgt 8y ago

    Compute resources tend to be significantly more expensive than storage. Our approach is two-fold: - We finance compute resources required for you to ingest data into BigQuery. With Redshift, you pay for ingest directly via compute cluster c
23. 113.▲
    by vgt 8y ago

    Great question. At the time we had a hard time replicating results of that blog post. Here's some food for thought. - We recently announced that we've improved our TPC-DS 10T geomean by 5x over past 18 months [0]. The nice thing i
24. 114.▲
    by vgt 8y ago

    Bq pm here. No papers, yes, but lots of talks and blog posts. Here's a list: https://medium.com/@thetinot/bigquery-required-reading-list-... Happy to answer any questions!
25. 115.▲
    by vgt 8y ago

    Thanks, this is very valuable feedback, worth in gold. Please feel free to email me directly to unpack our future plans here. The Netflix analogy also applies if they bill $0.001 per minute - the number I chose is not indicative of reality,
26. 116.▲
    by vgt 8y ago

    Thanks, can we continue this discussion? Super interesting to me. One clarification. BigQuery has two methods of ingest. The Streaming API you mention does carry additional cost, but for the added benefit of having your data appear in BigQu
27. 117.▲
    by vgt 8y ago

    Yes, essentially.. a software-defined cluster (not physical). It's a parallel pricing model. To be clear, my previous post's logic is not calling for an exception for this model - you trade efficiency for predictability.
28. 118.▲
    by vgt 8y ago

    Genuinely thanks for the info, this is super insightful. I'll argue that BigQuery's per-query pricing charges you JUST for the resources you use (well, data scaned), so it SHOULD be far less expensive than a model that charges you
29. 119.▲
    by vgt 8y ago

    BigQuery PM here. I'd love to genuinely understand why you have that impression. BigQuery's on-demand model charges you EXACTLY for what you consume. Meaning, your resource efficiency is 100% [0]. By contrast, typical "cluste
30. 120.▲
    by vgt 9y ago

    Nice analysis! That's the rub with doing tco analysis. How much value do you put on higher order of manageability? You should also include a workload volatility component to be entirely fair. Your analysis assumes it's entirely st