2 ms·
Why not Apache Beam? It doesn’t require Spark or Flink
by ewhauser421 7y ago
Why not Apache Beam? It doesn’t require Spark or Flink
- ewhauser421 7y ago(Beam has a DirectRunner which is just in memory)
- miraculixx 7y agoThanks for the question. Beam has a more complex execution model and AFAIK also needs some executor environment like Spark to really parallelize workloads. Given a mongodb that all producers and consumers can attach to, minibatch runs anywhere.