5 ms·
This is not a general solution, it’s a specific problem with a specific data shape, and processes specifically 1 billion rows on a 32GB machine.
by masklinn 3y ago
This is not a general solution, it’s a specific problem with a specific data shape, and processes specifically 1 billion rows on a 32GB machine.
- pletnes 3y agoAnd this is why file io is not the bottleneck - all the data is in RAM/disk cache.