The problem with many of these benchmarks is that they aren't exercising what they think they're exercising. Notice how tokyo tyrant and memcached track each o

The problem with many of these benchmarks is that they aren't exercising what they think they're exercising. Notice how tokyo tyrant and memcached track each other on the performance graphs while redis is doing much better? That's because memcached and tokyo tyrant using the same client library. Clearly the memcached client he's using isn't as well written as the redis client he's using. We in the memcached community are trying to figure out which clients behave properly and describe relative performance between clients so people who read things like this can get a feel for what that actually means in real world applications.