2 ms·
there are always things the warehouses can't build themselves. For example, with intermix.io, it was the tracing we had built for other tools like Looker and d
by scapecast 6y ago
there are always things the warehouses can't build themselves.
For example, with intermix.io, it was the tracing we had built for other tools like Looker and dbt. The insight was that the result of a DAG involves many different calculations across different tables. The metadata only tells you that the steps happened, but doesn't tell you in what sequence they happened, where the "hiccup", latency, etc.
Redshift is clearly suffering from Snowflake. I wrote about that in my post-mortem. That post also has a few battle scars:
https://medium.com/@larskamp/why-we-sold-intermix-io-to-private-equity-in-a-shifting-market-5bdb3e4e30a4 https://medium.com/@larskamp/why-we-sold-intermix-io-to-priv...
Ping me on LinkedIn if you care to hear more :-)
- sails 6y agoCheers, appreciate it, will ping you on LI!