3 ms·
Congratulations, second streaming acquisition in recent memory, after benthos. Arroyo on paper looks amazing, high performance, advanced streaming primitives l
by dm03514 1y ago
Congratulations, second streaming acquisition in recent memory, after benthos.
Arroyo on paper looks amazing, high performance, advanced streaming primitives like windows and joins.
I think / hope the foundations provide a long term alternative to flink and spark streaming, the extremely heavy jvm-based incumbents.
I only have ~5 hours of experience with it so def an ultra beginner, but it was very UI configuration heavy when I tried it. API based config was mentioned but didn’t slot into the way $dayjob provisions so it was a very hard sell.
In response to this I created a lightweight high performance dev-centric streaming solution powered by duckdb, it’s getting a little traction
https://github.com/turbolytics/sql-flow https://github.com/turbolytics/sql-flow
Iceberg has been one of the most popular feature so far:
https://sql-flow.com/docs/tutorials/iceberg-sink https://sql-flow.com/docs/tutorials/iceberg-sink