4 ms·
You lex the whole file, separate it into records and then process them? Doesn’t sound like you’re processing the file in parallel to me. TFA’s way would allow
by UncleEntity 5y ago
You lex the whole file, separate it into records and then process them?
Doesn’t sound like you’re processing the file in parallel to me.
TFA’s way would allow you to start at any arbitrary file position, just advance until you find a record separator then start parsing from there without having to worry about starting in the middle of a quoted string.
- tbrownaw 5y agoNot like sequential steps, a whole bunch of foreach / yield return loops until the last one dumps things onto a thread-safe queue.