700KB/s is embarrassingly slow! Modern computers are really fast. That's a couple of orders of magnitude slower than a WiFi transfer. 1000x slower than SSD rea

700KB/s is embarrassingly slow! Modern computers are really fast. That's a couple of orders of magnitude slower than a WiFi transfer. 1000x slower than SSD read speeds. TSV is possible to parse at RAM speeds — 5000x faster. I suspect that widespread use of scripting languages, and hosting on micro instances containerized like a turducken, with disks over network, set people's expectations pretty low. You don't need a cluster of 25 machines for simple tabulation of 200GB of data.