3 ms·

> The only reason they're not on the website is… … that no one has contributed them. > … with some fairly arbitrary rules about which languages/implementation

by igouy 12y ago

> The only reason they're not on the website is… … that no one has contributed them. > … with some fairly arbitrary rules about which languages/implementations are valid to include, e.g. PyPy is not allowed … Hundreds of programming language implementations are not included! It would take more time than I choose to donate. Been there; done that. http://benchmarksgame.alioth.debian.org/play.html#languagex http://benchmarksgame.alioth.debian.org/play.html#languagex > … and Java gets JIT warm-up time etc. Java does not get JIT warm-up time! Please stop making up misinformation! http://benchmarksgame.alioth.debian.org/play.html#measure http://benchmarksgame.alioth.debian.org/play.html#measure http://benchmarksgame.alioth.debian.org/play.html#java http://benchmarksgame.alioth.debian.org/play.html#java

dbaupp 12y ago
The site could be renamed to be "The Computer Language Implementation Benchmarks Game", since it's not testing the language speed (best approximated by the fastest known implementation), just certain implementations, some of which are designed with priorities above speed in mind (e.g. cPython). > Java does not get JIT warm-up time! Please stop making up misinformation! Oh, sorry! I must've been misremembering something someone told me. (Although, how does `Cold` differ from `Usual` there? It's not clear from the text what the difference is.)
- igouy 12y ago
  > best approximated by the fastest known implementation Best not to become so confused: " Measurement is highly specific -- the time taken for this benchmark task, by this toy program, with this programming language implementation, with these options, on this computer, with these workloads." > `Usual` http://benchmarksgame.alioth.debian.org/play.html#measure http://benchmarksgame.alioth.debian.org/play.html#measure > `Cold` http://benchmarksgame.alioth.debian.org/play.html#java http://benchmarksgame.alioth.debian.org/play.html#java "Here are some additional (Intel® Q6600® quad-core) elapsed time measurements, taken after the Java programs started and before they exited: In the first case (Cold), we simply started and measured the program 66 times; and then discarded the first measurement leaving 65 data points."

by igouy 12y ago

dbaupp 12y ago

The site could be renamed to be "The Computer Language Implementation Benchmarks Game", since it's not testing the language speed (best approximated by the fastest known implementation), just certain implementations, some of which are designed with priorities above speed in mind (e.g. cPython). > Java does not get JIT warm-up time! Please stop making up misinformation! Oh, sorry! I must've been misremembering something someone told me. (Although, how does `Cold` differ from `Usual` there? It's not clear from the text what the difference is.)

igouy 12y ago
> best approximated by the fastest known implementation Best not to become so confused: " Measurement is highly specific -- the time taken for this benchmark task, by this toy program, with this programming language implementation, with these options, on this computer, with these workloads." > `Usual` http://benchmarksgame.alioth.debian.org/play.html#measure http://benchmarksgame.alioth.debian.org/play.html#measure > `Cold` http://benchmarksgame.alioth.debian.org/play.html#java http://benchmarksgame.alioth.debian.org/play.html#java "Here are some additional (Intel® Q6600® quad-core) elapsed time measurements, taken after the Java programs started and before they exited: In the first case (Cold), we simply started and measured the program 66 times; and then discarded the first measurement leaving 65 data points."