3 ms·

If that’s your production environment then that’s where you should run them.

• dymk 8y ago
  That's not why you don't run them on a shared host. It's because every other tenant on the machine is going to make run of the same benchmark unpredictable, and it will likely vary greatly through the day. Even taking multiple runs of each benchmark isn't sufficient, because you don't know the usage patterns of other tenants.
  • pvg 8y ago
    You're making it sound like performance on such hosts in unknowable which isn't really accurate. 'Multiple runs of each benchmark' is vague enough to be potentially insufficient in just about any environment to boot.
    • eklavya 8y ago
      Variance matters though. Test where you can reasonably be sure about low variance.
      • pvg 8y ago
        Sure. But it can be measured and accounted for. The idea that you can't or shouldn't benchmark such environments seems weird, given that they're pretty popular.
        • deleted 8y ago
          [deleted]