5 ms·
For other folks interested in using this in Node.js, the performance of `simdjson.parse()` is currently slower than `JSON.parse()` due to the way C++ objects ar
by rattray 6y ago
For other folks interested in using this in Node.js, the performance of `simdjson.parse()` is currently slower than `JSON.parse()` due to the way C++ objects are converted to JS objects. It seems the same problem affects a Python implementation as well.
Performance-sensitive json-parsing Node users must do this instead:
require("simdjson").lazyParse(jsonString).valueForKeyPath("foo.bar[1]")
https://github.com/luizperes/simdjson_nodejs/issues/5 https://github.com/luizperes/simdjson_nodejs/issues/5
- deleted 6y ago[deleted]
- flywheel 6y agoThanks for posting this - I've been down that road. I regularly have to parse about 20GB of JSON split up into 8MB JSON files - tried this library but was sad that it didn't help. I'm currently using threading in nodejs and that has helped quite a bit though, parsing up to 8 of those files at a time has given me quite a performance boost - but I always want to do it faster. Switching to using C just isn't really a viable option though.
- bufferoverflow 6y agoYou can write a small program in C just for the parsing part. Then call it from Node.