3 ms·

This should be re-done with up to date versions of all programs. The authors mention having opened bug reports/existing known bugs. All contestants should have

• reikonomusha 12y ago
  Not necessarily. A sort of test with a somewhat random computation where implementations have not specifically tuned for said test can provide beneficial information. If you have enough of such tests, one can get a broad idea of the performance of such systems. The worst case is when people hyperoptimize for a particular benchmark, which tells you nothing. You see this especially in the Benchmarks Game.
• andreasvc 12y ago
  While that would be interesting, I don't see it as the responsibility of the author of a conference poster that has already been presented. It would make more sense for the authors of the various Python implementations to take this up as a benchmark.