3 ms·
The explicit bias is that the benchmarks game measures time used by programs. If that bias favors languages like C++ so be it.
by igouy 16y ago
The explicit bias is that the benchmarks game measures time used by programs. If that bias favors languages like C++ so be it.
- chc 16y agoI don't know if you're trolling or cocksure, but no, that is not what I was talking about. I said the constraints create a bias, not the measurements themselves. For example, the performance measurements are biased against most garbage collected languages because the rules don't allow any options to fine-tune the GC's behavior (which can make a big difference). Obviously, there are no equivalent rules forbidding people from fine-tuning C++'s manual memory management.
- igouy 16y agoIf the rules don't allow any options to fine-tune the GC's behavior how do you explain the use of options to fine-tune the GC's behavior here: http://shootout.alioth.debian.org/u32q/program.php?test=fasta&lang=clojure&id=2#log http://shootout.alioth.debian.org/u32q/program.php?test=fast... and here http://shootout.alioth.debian.org/u32q/program.php?test=knucleotide&lang=java&id=2#log http://shootout.alioth.debian.org/u32q/program.php?test=knuc... and here http://shootout.alioth.debian.org/u32q/program.php?test=mandelbrot&lang=clojure&id=2 http://shootout.alioth.debian.org/u32q/program.php?test=mand... and here http://shootout.alioth.debian.org/u32q/benchmark.php?test=pidigits&lang=jruby http://shootout.alioth.debian.org/u32q/benchmark.php?test=pi... and here http://shootout.alioth.debian.org/u32q/program.php?test=regexdna&lang=ghc&id=2#log http://shootout.alioth.debian.org/u32q/program.php?test=rege... and here http://shootout.alioth.debian.org/u32q/program.php?test=revcomp&lang=scala&id=4#log http://shootout.alioth.debian.org/u32q/program.php?test=revc... and ...
- igouy 16y agoSimply looking at the benchmarks game website shows that your general claim "the rules don't allow any options to fine-tune the GC's behavior" is wrong. Do you have any other claims that can be checked?