4 ms·

Spark being an example of a tool that (also) exists inside the Hadoop ecosystem and is still gaining acceptance due to popularity, but at the same time losing t

by teraku 6y ago

Spark being an example of a tool that (also) exists inside the Hadoop ecosystem and is still gaining acceptance due to popularity, but at the same time losing traction as better option are arising.

rory_isAdonk 6y ago
What better options? Can you drop some links? Thanks :)
- StreamBright 6y ago
  Depending on cloud vs on-prem.
  - teraku 6y ago
    Not really, just use Apache Beam and set the runner to whatever you have / prefer
    - StreamBright 6y ago
      No thanks. I do not see any value of the n+1 unnecessary abstraction over things that I am already familiar with. An average customer does not want to use these things either.
- teraku 6y ago
  So the main issue with Spark is that the streaming is not that great. In general a Spark cluster persé is not bad, but I see more and more people using Apache Beam and then just use a runner that either they already have or that fits them best. https://beam.apache.org/ https://beam.apache.org/
- eunos 6y ago
  Apache Flink