3 ms·
To the first point, yes, in materialized views, thanks for correcting me. I perceive it as a limitation of their micropartitioning working against the actual go
by kthejoker2 6y ago
To the first point, yes, in materialized views, thanks for correcting me. I perceive it as a limitation of their micropartitioning working against the actual goals of such a system, i.e. pushing even more work on data engineers to prep data.
And we're in agreement on the second part: my point is not that their solution isn't more efficient - it is - but it's treating predicate pushdown as some kind of deep synergy between Spark and Snowflake.
That is, it's more the marketing aspect - clueless execs see "Snowflake and Spark work great together" and a box is checked.