4 ms·
Any possibility of using mmap? https://en.wikipedia.org/wiki/Mmap https://en.wikipedia.org/wiki/Mmap
by wenc 6y ago
Any possibility of using mmap?
https://en.wikipedia.org/wiki/Mmap https://en.wikipedia.org/wiki/Mmap
- grandinj 6y agonot when you exceed the size of the pagefile/swapfile :-) But it's a good project, otherwise.
- cma 6y agommap can exceed pagefile/swapfile+ram if you are mapping a file and not anonymous pages.
- grandinj 6y agoyeah. In my situation (a) the file was 10x RAM (b) when this library parses a JSON it creates an in-memory tree representing the file which is approx 16x the size of the JSON file. Consequently it swapped so hard I was never going to finish processing. So I used a streaming parser, and it finished in minutes.