3 ms·
Batch processes IRL tend to “fetch” data, which is nothing like streaming. For example, I’ve worked with “batch” systems that periodically go do fetches from d
by efitz 1y ago
Batch processes IRL tend to “fetch” data, which is nothing like streaming.
For example, I’ve worked with “batch” systems that periodically go do fetches from databases or S3 buckets and then do lots of crunching, before storing the results.
Sometimes batch systems have separate fetchers and only operate vs a local store; they’re still batch.
Streaming systems may have local aggregation or clumping in the arriving information; that doesn’t make it a “batch” system. Likewise streaming systems may process more than one work item simultaneously; still not a “batch”.
I associate “batch” more with “schedule” or “periodic” and “fetch”; I associate “stream” with “continuous” and “receiver”.
- deleted 1y ago[deleted]