Wouldn't partial reads fix the RAM problem? e.g. something like this: https://stackoverflow.com/a/69888274 https://stackoverflow.com/a/69888274 It might not be

Wouldn't partial reads fix the RAM problem? e.g. something like this: https://stackoverflow.com/a/69888274 https://stackoverflow.com/a/69888274 It might not be fast, but a quick 1-off solution that you let run for a while would probably do that job. There shouldn't be a need to load the whole file into memory.