4 ms·
Would love to get perspectives from HN community - did you decide between Snowflake and Spark for data engineering? Which one did you pick, and why?
by ibains 6y ago
Would love to get perspectives from HN community - did you decide between Snowflake and Spark for data engineering? Which one did you pick, and why?
- sails 6y agoSnowflake through and through. I haven't used Spark, and have used Snowflake extensively, so I may be quite biased. I imagine Spark has advantages in certain very high performance ML workflows. (see my HN profile for links to my writing on the topic of Snowflake) I didn't really understand the blog post to be honest, and I also don't really know how appropriate a direct comparison between Snowflake and Spark is? Perhaps you can give your perspective.