10 ms·

What if the test data is random? Could just get lucky and get a happy day scenario.

• Vendan 10y ago
  Then both versions should get that "happy day"? If you are using distinct random data for each version, then you aren't really benchmarking properly.
  • bArray 10y ago
    It doesn't say that they both use the same data sets.
    • Vendan 10y ago
      If they are using different data sets, then I'd say it's an invalid benchmark.