7 ms·

TechEmpower wants to "provide representative performance measures across a wide field of web application frameworks." Do you think it succeeded in this regard?

TechEmpower wants to "provide representative performance measures across a wide field of web application frameworks." Do you think it succeeded in this regard? It seems like the results are pretty well received by the community in general, or at least I haven't seen a lot of people disregard these benchmarks or give them the CLBG treatment [1]. 1: https://benchmarksgame-team.pages.debian.net/benchmarksgame/why-measure-toy-benchmark-programs.html https://benchmarksgame-team.pages.debian.net/benchmarksgame/...

igouy 6y ago
> at least I haven't seen a lot of people disregard these benchmarks https://old.reddit.com/r/elixir/comments/ikpgbq/benchmark_phoenix_compare_to_fastest_frameworks/g3mdkru/ https://old.reddit.com/r/elixir/comments/ikpgbq/benchmark_ph... > the CLBG treatment Please say what you mean ?
- emmanueloga_ 6y ago
  The "The Computer Language Benchmarks Game", if I remember it right, did not start with that title, and the very authors have progressively made more and more emphasis in the fact that the programs are "toy benchmarks" and not useful to compare which language is "fastest". TechEmpower benchmarks, on the other hand, wants to "provide representative performance measures across a wide field of web application frameworks" (and proglang is a prominent part of the framework) so it seems away from the CLBG stance.
  - igouy 6y ago
    Fair enough. > which language is "fastest" Isn't that question too loose to be useful? Isn't it necessary to show that performance measures are representative if we want to claim they are?
  - igouy 6y ago
    > more and more emphasis Well, more and more literal / less and less sarcastic. Consider — "Some people have suggested that I summarize the results, or declare a winner. In order to satisfy this request, I have come up with a unique and subtle quantification system to score languages on their overall performance, which I call the Completely Random and Arbitrary Point System!, or CRAPS![TM], for short. … you can link this page (with properly selected CGI parameters) from your language advocacy page as the final proof of your language's supremacy! Think of the glory." https://web.archive.org/web/20010302143046/http://www.bagley.org/~doug/shootout/craps.shtml https://web.archive.org/web/20010302143046/http://www.bagley...

igouy 6y ago

> at least I haven't seen a lot of people disregard these benchmarks https://old.reddit.com/r/elixir/comments/ikpgbq/benchmark_phoenix_compare_to_fastest_frameworks/g3mdkru/ https://old.reddit.com/r/elixir/comments/ikpgbq/benchmark_ph... > the CLBG treatment Please say what you mean ?

emmanueloga_ 6y ago
The "The Computer Language Benchmarks Game", if I remember it right, did not start with that title, and the very authors have progressively made more and more emphasis in the fact that the programs are "toy benchmarks" and not useful to compare which language is "fastest". TechEmpower benchmarks, on the other hand, wants to "provide representative performance measures across a wide field of web application frameworks" (and proglang is a prominent part of the framework) so it seems away from the CLBG stance.
- igouy 6y ago
  Fair enough. > which language is "fastest" Isn't that question too loose to be useful? Isn't it necessary to show that performance measures are representative if we want to claim they are?
- igouy 6y ago
  > more and more emphasis Well, more and more literal / less and less sarcastic. Consider — "Some people have suggested that I summarize the results, or declare a winner. In order to satisfy this request, I have come up with a unique and subtle quantification system to score languages on their overall performance, which I call the Completely Random and Arbitrary Point System!, or CRAPS![TM], for short. … you can link this page (with properly selected CGI parameters) from your language advocacy page as the final proof of your language's supremacy! Think of the glory." https://web.archive.org/web/20010302143046/http://www.bagley.org/~doug/shootout/craps.shtml https://web.archive.org/web/20010302143046/http://www.bagley...