4 ms·
My complaint makes sense because I might have 100B records per day to process, and the delay to load them up is significant
by paulsutter 8y ago
My complaint makes sense because I might have 100B records per day to process, and the delay to load them up is significant
- wmf 8y agoCould you stream the data into memory as it is created so that loading data isn't in the critical path?
- AboutTheWhisles 8y agoDoes this software do that?
- gricardo99 8y agoYes, that’s common use case for kdb+
- edf13 8y agoCommon for any analytical setup... you'd integrate with many of the other stream processing engines available (Storm, Flink, Kafka, Spark... all depending on what you want to do).