3 ms·
You’ve described the tricks WarpSream does in their implementation, buffering data until a large enough chunk can be written to S3.
by ec109685 3y ago
You’ve described the tricks WarpSream does in their implementation, buffering data until a large enough chunk can be written to S3.
- onetimeuse92304 3y agoI didn't know that. I worked with some pretty large scale projects and solutions like this are my daily bread and butter to the point where it seems obvious to me but I have no idea what is/isn't obvious to general population of developers.