5 ms·
Oh god, just when web people were starting to understand how to create good benchmarks (https://blog.mozilla.org/nnethercote/2012/08/24/octane-minus-v8/ https:/
by nnethercote 14y ago
Oh god, just when web people were starting to understand how to create good benchmarks (https://blog.mozilla.org/nnethercote/2012/08/24/octane-minus-v8/ https://blog.mozilla.org/nnethercote/2012/08/24/octane-minus...), now we're going back to 1980s microbenchmark hell.
Doesn't anyone read Hennessy and Patterson any more? The best benchmarks are real apps, not crappy little microbenchmarks that measure a single thing.
(Can you hear that thud, thud, thud? It's the sound of me beating my head against my desk.)
- kevingadd 14y agoSome of the tests are indeed pretty awful. The canvas clearing test doesn't even draw anything, so it's literally the equivalent of benchmarking an empty for loop...
- nnethercote 14y agoSuperb! Also, they say "The current items that RoboHornet tests captures the major pain points of jQuery, Google Apps, Google Maps, Ember, Handlebars and Cappuccino" but one of the tests is "Calculating primes from 2 to N". Srsly. Hennessy and Patterson specifically mention the Sieve of Erastosthenes (a common prime number finding algorithm) as an example of a bad toy benchmark.
- jlebar 14y agoI filed a bug. https://github.com/robohornet/robohornet/issues/67 https://github.com/robohornet/robohornet/issues/67