4 ms·
I am not an expert in benchmarking, so maybe I'm missing something. But how is that not crazy? If I were looking to compare two things, I would run all the ben
by wpietri 12y ago
I am not an expert in benchmarking, so maybe I'm missing something. But how is that not crazy?
If I were looking to compare two things, I would run all the benchmarks on a single machine under my control. I might look at previously published reports to make sure I was getting comparable numbers. But there is no way I would publish a comparison that I merely hoped was apples to apples. I've just had too many benchmarks depend on subtle issues, ones that I had presumed were irrelevant.
- decklebench 12y agoThe benchmarks reported on the web page (http://ponylang.org http://ponylang.org) and also reported at http://ponylang.org/papers/fast-cheap.pdf http://ponylang.org/papers/fast-cheap.pdf are more recent, and for these the code was run for different languages, and on one machine.