sync_jeff

7 ms·

1.
by sync_jeff 3y ago
Understanding why your job performance is changing is critical to both optimize costs and prevent crashes. In this post we show a new visualization timeline features to help engineers find root causes quickly
2.
by sync_jeff 3y ago
Thanks for reading!
3.
by sync_jeff 3y ago
We provide our own perspective on the high level comparison between Databricks and Snowflake
4.
by sync_jeff 3y ago
We built an ML-powered Databricks cluster optimization tool to help remove the tedious work of tuning Jobs clusters to lower costs. We recently shipped a huge upgrade to our product, Gradient, that can automatically improve your job cluster
5.
by sync_jeff 3y ago
We ran a $12K experiment to test the cost and performance of Serverless warehouses and dbt concurrent threads, and obtained unexpected results.
6.
by sync_jeff 3y ago
Databricks provides two different ways to monitor usage and costs. In this post we look at the pros and cons of both solutions.
7.
by sync_jeff 3y ago
Realities of company and cloud complexities require new levels of control and autonomy to meet business goals at scale
8.
by sync_jeff 3y ago
Realities of company and cloud complexities require new levels of control and autonomy to meet business goals at scale
9.
by sync_jeff 3y ago
In this blog we run the TPC-DS benchmark to see the cost and performance benefits of Photon and Graviton instances on Databricks. The results are intriguing and reveal a techno-economic struggle!
10.
by sync_jeff 3y ago
Our new tool that enables users to programmatically optimize their Databricks clusters.
11.
by sync_jeff 3y ago
In this blog you'll learn how to integrate Gradient, an optimization service, into Airflow + Databricks to lower costs and hit runtime goals.
12.
by sync_jeff 3y ago
In our blog we discuss our data science work on how we built a system that optimizes Databricks clusters.
13.
Sync Autotuner Reduced Our EMR Cost by 25%(medium.com)
1 points by sync_jeff 4y ago|1 comments
14.
by sync_jeff 4y ago
Customer blog on how the Sync Autotuner API integrated with their Airflow infrastructure helped to optimize their ApacheSpark clusters.
15.
Do Graviton instances lower costs for Spark on EMR on AWS?(synccomputing.com)
2 points by sync_jeff 4y ago|2 comments
16.
by sync_jeff 4y ago
We perform a cost and runtime evaluation of Graviton instances for Apache Spark on EMR AWS using the TPC-DS 1TB benchmark.
17.
How does the worker size impact costs for Apache Spark on EMR AWS?(medium.com)
1 points by sync_jeff 4y ago|1 comments
18.
by sync_jeff 4y ago
In this blog we analyze the impact of varying the worker instance size on cost and performance of Apache Spark in EMR using the TPC-DS 1TB benchmark.
19.
by sync_jeff 4y ago
We take a deep dive into the costs performance of Databricks's autoscaling algorithm with the TPC-DS benchmark.