3 ms·
Materialize.com and Snowflake have pretty reliable incremental materialised views now, with caveats that aren’t back breaking. If you can transform in SQL rathe
by thom 1y ago
Materialize.com and Snowflake have pretty reliable incremental materialised views now, with caveats that aren’t back breaking. If you can transform in SQL rather than having to build a whole new pipeline or microservice to do the work that’s a pure operational win. I consider this alongside hybrid transactional/analytical databases to be the holy grail of data infrastructure. Finally we can stop just shuffling data around, support almost all workloads in one place, and get some work done.
- viccis 1y agoYep Databricks does this pretty well too. I think their sales jargon for it is the "Enzyme engine"
- MangoToupe 1y ago> Finally we can stop just shuffling data around Bro that's your entire job description. What is left?
- thom 1y agoDeciding what colour it should be.