3 ms·

Thank you. I actually like the idea that I can split the processing into independent binaries and scale them manually. And especially the fact that I can implem

by splix 3y ago

Thank you. I actually like the idea that I can split the processing into independent binaries and scale them manually. And especially the fact that I can implement it in Rust. Btw, another questions. Things like Flink provide a dashboard to analyze the processing flow / graph, to see the bottlenecks, etc. To my understanding Hydroflow doesn't provide it yet, but I'm curious if you're working on something like that, or if it provides other kind of metrics, perhaps something compatible with Grafana?

mingweisamuel 3y ago
Yeah, nothing like that provided and won't have anything like that for a while. Currently you would have to wire-in your own instrumentation in the dataflow graph.
- splix 3y ago
  Ah, I see. Thank you. I will definitely try it
- splix 3y ago
  I guess more a closer comparison would be with the Project Reactor https://projectreactor.io/ https://projectreactor.io/ which is also a low level framework for data processing.