5 ms·
When I compare databases, I also search out the performance comparisons created or sponsored by my preferred database provider, then I know that I can trust the
by bhouston 11y ago
When I compare databases, I also search out the performance comparisons created or sponsored by my preferred database provider, then I know that I can trust the results to be complete and unbiased./sarcasm
Seriously, why is this one of the top stories on HN? These types of tests are so easy to tweak in favor of a perferred database that they are completely unreliable. Even neutral comparisons by third parties are rife with errors like not adding proper indices to all the DBs or using query formulations that avoid the indices on some DBs or other configuration issues (DBs are unfortunately tricky.)
I think the only way to do this objectively is to have a test and then give each DB vendor an opportunity to tweak the DB and queries to optimize performance. Seeing how DB vendors optimized performance would actually be very informative to potential users. Everything else is just a comedy of errors (or worse) as normally people usually only have good expertise in one of the DBs in question, if that.
- porker 11y ago> I think the only way to do this objectively is to have a test and then give each DB vendor an opportunity to tweak the DB and queries to optimize performance. AFAIK they are: the test is open source, the raw results are there, and contributions welcomed. Hopefully the OrientDB team will step up and show how theirs can perform.
- lvca 11y agoWe (OrientDB Team) had the chance to look at the code and we're preparing a Pull Request. Stay tuned for the new results ;-)
- lvca 11y agoHey all, we sent a Pull Request 2 days ago to the author of the Benchmark, as they used OrientDB incorrectly. Now OrientDB is the fastest in all the benchmarks, except for "singleRead" and "neighbors2", but we know why. We are still waiting for the Arango team to update the results...
- orientdb_leaks 11y agoLvca, good to see the OrientDB team cooperating in the benchmark. Performance is just one aspect when evaluating a database, other things like robustness, stability, community can be as important if not more important. As such as I’ve shared my 10 month experience with OrientDB in: http://orientdbleaks.blogspot.com/2015/06/the-orientdb-issues-that-made-us-give-up.html http://orientdbleaks.blogspot.com/2015/06/the-orientdb-issue...
- porker 11y ago> Hey all, we sent a Pull Request 2 days ago [...] We are still waiting for the Arango team to update the results... Let's see: 1. You sent it at the weekend 2. The Arango team have a life 3. It took you 9 days to send the PR 4. The start of the week always is busy, regardless of which company you work at... Give over and stop trying to make out there is something suspicious in whatever the Arango team do. It makes you (look like) a jerk.
- tracker1 11y agoIt looks like the source of the test is out there for others to compare/review... which is far better than many of these types of tests do. I'm not an ArrangoDB person, I've done a bit with other NoSQL variants, but will say their approach is fine. They don't even come out on top in all the tests... It's mainly about showing how they compare performance wise, so that they can concentrate on selling based on features. Which is a pretty fair approach, and I wish them luck. Also, in looking, it seems that they have pretty broad platform support as well.