4 ms·
Interesting to see how Heron compares up to Spark wrt to performance. I keep hearing Storm is slower than Spark, does Heron now catch up and exceed in terms of
by filereaper 11y ago
Interesting to see how Heron compares up to Spark wrt to performance. I keep hearing Storm is slower than Spark, does Heron now catch up and exceed in terms of performance?
- bbulkow 11y agoI have run into the author in other contexts, and I believe (without quotable proof) that Heron must be massively faster than Storm - if he says it is. Storm has a wide variety of failures (I've presented about "when to use storm" at a few conferences), such as the difficulty of exactly once processing (trident attempted to solve that). I am looking forward to taking Heron for a spin.
- nl 11y agoThe linked blog posts show that is is faster that Storm. The OP was asking about Spark though. That's a fair questions, since there is a good deal of overlap between the the typical Storm usecases and Spark usecases.
- lukeasrodgers 11y agoAgreed -- the paper mentions "there are a number of issues with respect to making these systems [Spark and Samza] work in its current form at our scale" but unfortunately does not outline go into any detail.