4 ms·
Does ${corporate} prevent you from merging your jsons to a single file with a decent format like parquet?
by nurettin 2y ago
Does ${corporate} prevent you from merging your jsons to a single file with a decent format like parquet?
- dgan 2y agothey don't but that defeats the purpose. i want to be able to inspect the insides, so binary formats are out, i have to easily open & read the content
- nurettin 2y agoI don't get how you can't put the content within the merged file and query it but good luck.
- dgan 2y agobecause that d be a several hundreds megabytes json :) Anyway with suggestion in another comment, i moved the root directory into an antivirus-excluded location, which gave me almost a 10 times performance win