3 ms·
No, S3, as MinIO, has a read-after-write consistency. So indexing would block on either writes or reads until it is done. We block when doing the zip indexing,
by klauspost 5y ago
No, S3, as MinIO, has a read-after-write consistency.
So indexing would block on either writes or reads until it is done. We block when doing the zip indexing, but that is much more lightweight - and we limit to 100MB ZIP directory. That way we don't risk long-blocking index operations.
- remram 5y agoI see. Indeed that is a potentially long time to block.