I would say that doing the other guy's benchmark is the most objective thing you can do. You should take it one step further and include other competitive prod

I would say that doing the other guy's benchmark is the most objective thing you can do. You should take it one step further and include other competitive products. In this case, it's pretty easy to beat the crap out of Oracle, it's an elephant. I would challenge the MemDB guys to run the same benchmark against VoltDB and report on that. Also, let's get down to brass tacks - I don't see the actual queries that are being graphed in the MemDB post, and what is that graph actually measuring? I think the LMDB team has done a really good job with this type of comparative benchmark. They took the LevelDB benches, then ran them against a lot of competitive products, both new and legacy, and gave a really good view of the entire field, in terms of performance on a number of dimensions: http://symas.com/mdb/inmem/ http://symas.com/mdb/inmem/ http://symas.com/mdb/inmem/scaling.html http://symas.com/mdb/inmem/scaling.html