2 ms·
Cursed engineering: jumping randomly through CSV files without hurting yourself
- Yomguithereal 8mo agoTL;DR: Seeker struct from simd-csv Rust crate knows how to perform approximate random access in a CSV file [1] The `xan` command line tool is therefore able to use it to perform single-pass map-reduce parallelization over CSV files and also binary search within sorted CSV data! [2] [1]: https://docs.rs/simd-csv/latest/simd_csv/struct.Seeker.html https://docs.rs/simd-csv/latest/simd_csv/struct.Seeker.html [2]: https://github.com/medialab/xan/ https://github.com/medialab/xan/