> Why mandate how the benchmark is implemented? Otherwise you won't be able to compare the results. For example, the Benchmarks Game [1] specifies how the alg

> Why mandate how the benchmark is implemented? Otherwise you won't be able to compare the results. For example, the Benchmarks Game [1] specifies how the algorithms in those benchmarks should work. For some of the benchmarks, there are faster algorithms. However, it's not about comparing algorithms, it's about comparing language implementations. [1] http://benchmarksgame.alioth.debian.org/ http://benchmarksgame.alioth.debian.org/