4 ms·
Huge log files are one use case. Large datasets are another, in data analysis, machine learning, and ETL tasks.
by nerdponx 5y ago
Huge log files are one use case. Large datasets are another, in data analysis, machine learning, and ETL tasks.
- mayama 5y agoAren't log files processed a line at a time? Last time I had to deal with some structured log, I streamed lines concurrently into json parser and it went pretty fast.