4 ms·
You should try Databricks, especially the new Photon engine powering Spark. In general more performant than Snowflake in SQL and a lot more flexible. (There are
by rxin 5y ago
You should try Databricks, especially the new Photon engine powering Spark. In general more performant than Snowflake in SQL and a lot more flexible. (There are some cases in which Databricks would be slower but the perf is improving rapidly.)
- Fiahil 5y agoDatabricks has an extremely bad API. So, sure, your Spark jobs might be a little bit faster some times, but why would you use it if you can't even read logs of running jobs?
- soulbadguy 5y agoVery surprised by this. Do you have a reference ?
- fnord123 5y agoFyi, rxin is co-founder of databricks.
- soulbadguy 5y agoThat explains it
- deleted 5y ago[deleted]
- StreamBright 5y agoThe biggest selling point of Snowflake for most of the customers is that they do not need to maintain the infrastructure.
- fritkot 5y agoOf course you would say that it's more performant and flexible ...TCP-DS was just a PR ploy
- belter 5y agoProbably an oversight on your part, but I would argue would be elegant to disclose you are one of the co-founders.
- Lucasoato 5y agoDatabricks is amazing, the Delta Live Table technology is incredible. It's very hard to approach problems like Data Lineage and Data Quality, but that platform does it in the right way. My only concern is that they offer just a managed cloud product. That's cool for startups, but large enterprises sometimes need more governance and ownership than that.