3 ms·
fread can also accept a shell command which it will run and use the result as input. I use that to grep the lines I want from files too big for RAM.
by vharuck 6y ago
fread can also accept a shell command which it will run and use the result as input. I use that to grep the lines I want from files too big for RAM.
- nojito 6y agoSame here! I also use fwrite to send it back to the shell to continue my processing pipeline. https://www.rdocumentation.org/packages/data.table/versions/1.12.8/topics/fwrite https://www.rdocumentation.org/packages/data.table/versions/... It's mind boggling how little fanfare data.table has despite it being the best way to handle tabular data in 2020.