3 ms·

Sweet - I built the streams feature in DynamoDB (well tech lead). Awesome to see it on HN!

• reilly3000 7y ago
  Awesome work, I really think Streams is the killer feature of DynamoDB. Are there any plans on the roadmap to allow for filtered/faceted streams or Streams of a single GSI? How about consolidation between DDB streams and Kinesis? It would be great if the "DynamoDB Streams Kinesis Adapter" program didn't need to exist :) My main pain point has been around how many times a lambda is invoked to consume a stream on a busy table but I really appreciate the record batching aspect of them.
  • SubuSS 7y ago
    Thanks! Let me also preface this a bit: I built that 5 years ago :). I've been out of AWS (in snap) for the past 4 years. So I will have to wait on the current owners to answer this. But last I checked, - faceted streams wasn't in plan - streams pretty much expose a cleaned up version of base table's replication logs. In theory they could do the same for a GSI (by exposing its logs), I don't know if there's enough demand. - Kinesis and Dynamo used the same backing storage technology. By itself, Kinesis didn't provide some of the guarantees that we wanted IIRC - so there was a different story. Also I don't think customers will want to pay for kinesis (streams was free?). You may want to expand on why kinesis streams is better for your use case though. - yes batching was indeed put in place for this. In fact I know of big enough tables where the shard listing part got to be the bottleneck, but that should be a corner case.