3 ms·
I've been watching the great progress since 1.4, but I continue to be disappointed by the overall performance, makes me wonder if I'm not groking something. Her
by wiremine 13y ago
I've been watching the great progress since 1.4, but I continue to be disappointed by the overall performance, makes me wonder if I'm not groking something. Here's a gist of a simple ruby script to insert 1000 trivial docs into rethink:
https://gist.github.com/wiremine/6245910 https://gist.github.com/wiremine/6245910
1,000 inserts are taking around 20 seconds. Hardware is a 1.8 Core i5 Mac Air with 4GB Ram and a 128 SSD.
Is this sort of performance expected at this point?
- neumino 13y agoBatching inserts make them faster https://gist.github.com/wiremine/6245910#comment-887640 https://gist.github.com/wiremine/6245910#comment-887640 13.618112323 seconds vs 0.591895712 seconds (on my laptop -- X1 Carbon) Using soft durability make things faster too, but that's cheating.
- dkhenry 13y agoYou have something wrong there. I just ranthe test suite I ship with my java driver against and I am able to do 2048 documents in about a second. Most of that time is spend in serializing the data to go over the wire and each insert is being done individually and in raw protobuf form. If you send in JSON and you queued up your inserts I imagine you could do even better.
- coffeemug 13y agoThis sort of thing isn't expected. Please check the following troubleshooting entry for slow inserts: http://rethinkdb.com/docs/troubleshooting/#my-insert-queries-are-slow.-how-can-i-speed-t http://rethinkdb.com/docs/troubleshooting/#my-insert-queries...
- wiremine 13y agoThanks for the info! Makes sense. Is this performance you're expecting in the long-term, or will this be tuned at some point?
- coffeemug 13y agoPerformance tuning never stops. We have one more release coming up that will squash a lion's share of low-hanging performance fruit. After that, we'll be tuning continuously, but it will be slow, incremental improvement.