3 ms·

Thanks for sharing. Are there any dataflow frameworks you are particularly pleased with at the moment?

• thom 5y ago
  I think Materialize is a wonderful product for what it is, but is somewhat narrow. At the very least I'd love if it started to incorporate window functions as well as just lateral queries though. A gap in the market that I'd like to see filled is stateful stream processing where you care about sequences of events. Kafka Streams removes the need to care about windows and watermarks, for example, so you can accommodate extremely late data in a simple aggregate, but no frameworks that I'm aware of make it easy to work with state machines over sequential data where events in that sequence might arrive or be updated later. Give me the illusion of being able to run forward-only logic over an entire historical dataset on every update, while remaining fast, and I'd be a very happy camper.
  • truculent 5y ago
    Materialize looks fantastic. Thank you