4 ms·
The slides [1] helped me grok what problems this tool solves pretty quickly. Everything big data is moving to blob storage these days, but streaming can lead t
by jimsparkman 4y ago
The slides [1] helped me grok what problems this tool solves pretty quickly.
Everything big data is moving to blob storage these days, but streaming can lead to small files problem or longer latencies. File fragments stored locally with proxied readers seems like a simple solution to that.
[1] https://gazette.readthedocs.io/en/latest/overview-slides.html# https://gazette.readthedocs.io/en/latest/overview-slides.htm...
- sitkack 4y agoSmall files should be in arrow/avro/parquet if your architecture allows (one should strive for this from the beginning).