4 ms·
I think the article is spot on about workflow but off on tech. Under the hood, Cubes will be back. Snowflake is the cubeless column store. And now firebolt c
by willvarfar 5y ago
I think the article is spot on about workflow but off on tech. Under the hood, Cubes will be back.
Snowflake is the cubeless column store.
And now firebolt comes along, promising order of magnitudes improvement. How? Largely “join indexes” and “aggregation indexes” which seem to smell like cubes.
So take the modern column store and slap some cubes in front.
In firebolt this seems to be added by programmers. But I think the future will see olap mpp engines that transparently pick cubes, maintain them, reuse them and discard them all automatically.
- dominotw 5y ago> How? Largely “join indexes” and “aggregation indexes” which seem to smell like cubes. Just curious. What stops snowflake from adding these too. Trying to understand what innovation firebolt is doing.
- willvarfar 5y agoHopefully nothing. I only understand these systems about as well as you can without actually fighting them in production, so ymmv ;) There are things that Firebolt are doing regards SSD caching that its easy to see are going to massively help performance but also hinder one nice aspect of Snowflake which is that one Snowflake region can read-only access the storage of another. I'm guessing that this is via direct S3 access, but the moment there is tiered storage, inter-cluster and inter-region access would have to be inter-compute-cluster instead etc.