3 ms·
Just because something isnt the slowest part of your pipeline doesn't mean it's not worth optimising. It might be the slowest part of the pipeline you control,
by maccard 6y ago
Just because something isnt the slowest part of your pipeline doesn't mean it's not worth optimising.
It might be the slowest part of the pipeline you control, or your network might be a local network where your throughput is 10G. Modern SSDs can do 3+GB/second. Even if you're aiming at 1GB/second, your json parser has to be able to do 0.1ms/MB to be able to keep with even a normal disk. If JSON parsing is fast enough, you can use it as an interchange format high performance tasks, and if it's your input and output format, you can use existing tools for non performance critical tasks that use json already!