3 ms·
Yes I often have to pluck out attributes from streams of json records (1 json object per line) - often millions/billions. jq is almost always the bottleneck i
by minaguib 6y ago
Yes
I often have to pluck out attributes from streams of json records (1 json object per line) - often millions/billions.
jq is almost always the bottleneck in the pipeline at 100% CPU - so much so that we often add an fgrep to the left side of the pipeline to minimize the input to jq as much as possible.