3 ms·
Dominique Brezinski's latest Spark Summit talk is what cemented my feeling that superstar economics are at play in the current marketplace (in certain fields):
by MrPowers 6y ago
Dominique Brezinski's latest Spark Summit talk is what cemented my feeling that superstar economics are at play in the current marketplace (in certain fields): https://databricks.com/session_na20/patterns-and-operational-insights-from-the-first-users-of-delta-lake https://databricks.com/session_na20/patterns-and-operational...
He talks about the data processing framework he built that's ingesting "hundreds of terabytes, approaching a petabyte a day".
New technologies let small teams do tons of work.