8 ms·
It’s a horrible use of the tech. It’s like storing jpgs in postgres. You can do it, it’s just a really bad idea.
by brianwawok 4y ago
It’s a horrible use of the tech. It’s like storing jpgs in postgres. You can do it, it’s just a really bad idea.
- riku_iki 4y agoit depends, storing files in cassandra and jpgs in postgress allows you to not add another software with bugs and maintenance burden. If it works - everything is fine.
- alexott 4y agoIt may work, until you start to perform maintenance things, like repair, or new node bootstrap, etc. Then it may fail with high probability
- peytoncasper 4y agoDepends heavily on the use case. I know multiple video related companies that chunked data for replays into 1s and 500ms segments. Having many keys, means that you can preform thousands of asynchronous requests for small pieces of data and then piece it together on the client side. Super low latency is just something else to optimize for.
- alexott 4y agoBut then you need to push these segments into partitions, and big partitions are really bad, especially for old versions of Cassandra… Although I met customers with partitions of size of 100Gbs…
- peytoncasper 4y agoAs another commenter said, 500ms clip is super tiny. Each key is a a separate partition. So each segment is a separate partition.
- riku_iki 4y agochunks will be evenly distributed between many partitions, no need to store chunks in one partition.