I can almost understand why they do it. Benchmarking is incredibly hard to do correctly, and it requires a very deep understanding of software and hardware. Fo

I can almost understand why they do it. Benchmarking is incredibly hard to do correctly, and it requires a very deep understanding of software and hardware. For example, I remember hearing about Joyent's port of KVM to Illumos. They were testing the Illumos KVM against Linux KVM, and the Illumos KVM was faster. After a lot of debugging, they realized the Illumos machine was turboboosting better than the Linux machine, since it was in a colder part of the data center.