5 ms·
Yeah I agree. I've had a lot of practice so far with coordinating between hundreds of thousands of tables to ensure ingestion/lookup is fast. Everything boils
by sdesol 3y ago
Yeah I agree. I've had a lot of practice so far with coordinating between hundreds of thousands of tables to ensure ingestion/lookup is fast. Everything boils down to optimizing for your query patterns.
I also believe in using what I call "compass tables" (like your summarization tables), which I guess are indexes of indexes.
- bevekspldnw 3y agoScaling databases both oddly frustrating and also rewarding. Getting that first query that executes at 10x of the old one feels great. The week of agony that makes it possible…less so.
- sdesol 3y agoFully agree. I do have to give hardware a lot of credit though. With SSD and now NVME, fast random read/write speed is what makes a lot of things possible.
- bevekspldnw 3y agoYup, I just wish Samsung made an 8TB NVME!