3 ms·
Out of interest, what created a 90GB JSON file?
by arethuza 6y ago
Out of interest, what created a 90GB JSON file?
- lllr_finger 6y agoNot OP, but I routinely call a specific HTTP API for millions of entities or pull down entire Kafka topics - all in JSON format. For various reasons those are the canonical sources of data and/or the most performant, so I end up ripping through GBs and GBs of JSON when troubleshooting/reporting on things.
- nicoburns 6y agoA Firebase Realtime Database backup file
- hobofan 6y agoI don't think it's quite 90GB, but I've processed Wikidata dumps in the same order of magnitude before (which are one JSON object per line) with jq, and it could've certainly been faster.
- arethuza 6y agoI was wondering about that - whether they are one single JSON array/object or one per line.