4 ms·

The Computer Language Benchmarks Game

7 points by xwvvvvwx 10y ago

igouy 10y ago
Anything specific catch your attention ?
- igouy 10y ago
  Coincidentally, I have now just published an update which includes fixed Lua programs and refreshed boxplots.
- geezerjay 10y ago
  > Anything specific catch your attention ? It proves that implementations in C compiled with GCC are linked with the fastest times, higher than Rust, Go, and even Fortran code compiled with Intel's compiler. Considering how many people criticize C for any number of reasons, these benchmarks indicate that the complaints contrast with the actual real-world performance.
  - steveklabnik 10y ago
    There's lots of reasons for this that have more to do with the game than with "actual real-world performance."
    - igouy 10y ago
      Perhaps there are reasons that effect both toy benchmark and "real-world" performance ;-)
      - steveklabnik 10y ago
        There is one big one, but I mostly saw my comment being in line with your policies: the game is a game. You say yourself have this on pages like http://benchmarksgame.alioth.debian.org/dont-jump-to-conclusions.html http://benchmarksgame.alioth.debian.org/dont-jump-to-conclus...
        igouy 10y ago
        One delight of our conversations is the way we can so often find different meaning in the same words; or select differently from the same words to find our meaning ;) > … the game is a game… on pages like… There doesn't seem to be anything like that on the page you reference, but we can find some clarity on another page: The name "benchmarks game" signifies nothing more than the fact that programmers contribute programs that compete (but try to remain comparable) for fun not money. http://benchmarksgame.alioth.debian.org/sometimes-people-just-make-up-stuff.html#name-game http://benchmarksgame.alioth.debian.org/sometimes-people-jus...
        steveklabnik 10y ago
        Totally! I just want to make it clear that I'm not trying to disparage the game itself.
    - geezerjay 10y ago
      > There's lots of reasons for this that have more to do with the game than with "actual real-world performance." I'm sure if this was close to be true then anyone would already have proposed fixes and changes to the benchmarks. Vague, baseless claims do not have any impact on performance.
  - igouy 10y ago
    Isn't the contrast with "toy benchmark" performance rather than with "actual real-world performance" ? http://benchmarksgame.alioth.debian.org/why-measure-toy-benchmark-programs.html http://benchmarksgame.alioth.debian.org/why-measure-toy-benc...
    - geezerjay 10y ago
      The benchmarks do exist in the real world, and run code written in the real world. Hence, they indicate real-world performance. That doesn't mean that all possible programs will perform exactly like that.
      - igouy 10y ago
        Which is just to say they are measurements of programs. I expect you understand the phrase "real-world performance" implies more than that.
duneroadrunner 10y ago
While this is a great site for comparing "maximum language speed potential", I think in 2016 it would also be of interest to compare the performance of memory safe implementations as well. This would be particularly relevant for languages like Rust, C++ and Swift. Btw, memory safe C++ implementations of some of those benchmarks can be found here: note shameless plug: https://github.com/duneroadrunner/SaferCPlusPlus-BenchmarksGame https://github.com/duneroadrunner/SaferCPlusPlus-BenchmarksG...
- deleted 10y ago
  [deleted]
Scaevolus 10y ago
This page used to be a lot more expansive (including nice charts!) before November 2015, when it was radically stripped down. I think the maintainer lost interest. http://web.archive.org/web/20151009090721/http://benchmarksgame.alioth.debian.org/ http://web.archive.org/web/20151009090721/http://benchmarksg...
- igouy 10y ago
  I think the maintainer spent October 2015 re-writing PHP and HTML and CSS to make something that would be readable on a mobile phone. (A couple of years nag-nag-nag from Google "Webmaster Tools" "Mobile Usability" page finally nudged me into action. Now mobile use on Saturdays has risen from 5% to above 30%).
- igouy 10y ago
  > nice charts! The charts are nice; now! (SVG instead of PNG bitmaps.) http://benchmarksgame.alioth.debian.org/for-programming-language-researchers.html http://benchmarksgame.alioth.debian.org/for-programming-lang... http://benchmarksgame.alioth.debian.org/u64q/which-programs-are-fastest.html http://benchmarksgame.alioth.debian.org/u64q/which-programs-... The instant without-thought comparison charts were removed to force readers to slow-down and (vain hope) think.

7 points by xwvvvvwx 10y ago

igouy 10y ago

Anything specific catch your attention ?

igouy 10y ago
Coincidentally, I have now just published an update which includes fixed Lua programs and refreshed boxplots.
geezerjay 10y ago
> Anything specific catch your attention ? It proves that implementations in C compiled with GCC are linked with the fastest times, higher than Rust, Go, and even Fortran code compiled with Intel's compiler. Considering how many people criticize C for any number of reasons, these benchmarks indicate that the complaints contrast with the actual real-world performance.
- steveklabnik 10y ago
  There's lots of reasons for this that have more to do with the game than with "actual real-world performance."
  - igouy 10y ago
    Perhaps there are reasons that effect both toy benchmark and "real-world" performance ;-)
    - steveklabnik 10y ago
      There is one big one, but I mostly saw my comment being in line with your policies: the game is a game. You say yourself have this on pages like http://benchmarksgame.alioth.debian.org/dont-jump-to-conclusions.html http://benchmarksgame.alioth.debian.org/dont-jump-to-conclus...
      - igouy 10y ago
        One delight of our conversations is the way we can so often find different meaning in the same words; or select differently from the same words to find our meaning ;) > … the game is a game… on pages like… There doesn't seem to be anything like that on the page you reference, but we can find some clarity on another page: The name "benchmarks game" signifies nothing more than the fact that programmers contribute programs that compete (but try to remain comparable) for fun not money. http://benchmarksgame.alioth.debian.org/sometimes-people-just-make-up-stuff.html#name-game http://benchmarksgame.alioth.debian.org/sometimes-people-jus...
        steveklabnik 10y ago
        Totally! I just want to make it clear that I'm not trying to disparage the game itself.
  - geezerjay 10y ago
    > There's lots of reasons for this that have more to do with the game than with "actual real-world performance." I'm sure if this was close to be true then anyone would already have proposed fixes and changes to the benchmarks. Vague, baseless claims do not have any impact on performance.
- igouy 10y ago
  Isn't the contrast with "toy benchmark" performance rather than with "actual real-world performance" ? http://benchmarksgame.alioth.debian.org/why-measure-toy-benchmark-programs.html http://benchmarksgame.alioth.debian.org/why-measure-toy-benc...
  - geezerjay 10y ago
    The benchmarks do exist in the real world, and run code written in the real world. Hence, they indicate real-world performance. That doesn't mean that all possible programs will perform exactly like that.
    - igouy 10y ago
      Which is just to say they are measurements of programs. I expect you understand the phrase "real-world performance" implies more than that.

duneroadrunner 10y ago

While this is a great site for comparing "maximum language speed potential", I think in 2016 it would also be of interest to compare the performance of memory safe implementations as well. This would be particularly relevant for languages like Rust, C++ and Swift. Btw, memory safe C++ implementations of some of those benchmarks can be found here: note shameless plug: https://github.com/duneroadrunner/SaferCPlusPlus-BenchmarksGame https://github.com/duneroadrunner/SaferCPlusPlus-BenchmarksG...

deleted 10y ago
[deleted]

Scaevolus 10y ago

This page used to be a lot more expansive (including nice charts!) before November 2015, when it was radically stripped down. I think the maintainer lost interest. http://web.archive.org/web/20151009090721/http://benchmarksgame.alioth.debian.org/ http://web.archive.org/web/20151009090721/http://benchmarksg...

igouy 10y ago
I think the maintainer spent October 2015 re-writing PHP and HTML and CSS to make something that would be readable on a mobile phone. (A couple of years nag-nag-nag from Google "Webmaster Tools" "Mobile Usability" page finally nudged me into action. Now mobile use on Saturdays has risen from 5% to above 30%).
igouy 10y ago
> nice charts! The charts are nice; now! (SVG instead of PNG bitmaps.) http://benchmarksgame.alioth.debian.org/for-programming-language-researchers.html http://benchmarksgame.alioth.debian.org/for-programming-lang... http://benchmarksgame.alioth.debian.org/u64q/which-programs-are-fastest.html http://benchmarksgame.alioth.debian.org/u64q/which-programs-... The instant without-thought comparison charts were removed to force readers to slow-down and (vain hope) think.