4 ms·

Saying "I didn't want to customize the environment" is disingenuous -- it means you're just benchmarking the default configurations, not the performance of the

• justinsb 17y ago
  I think the idea is to get away from the messy situation you see in TPC database benchmarks, where the environments are highly tweaked by the vendor just for that TPC test, and this bears no relation to the performance you actually get as a real world customer. I think he's re-running the tests anyway where the vendor suggested a tweak; I would take a more hard-line approach (if it isn't what you ship, it's not what I'll test). If the vendor's customer support is responsive and suggests a reasonable tweak, I can see the need for a more nuanced approach!
  • ckeck 17y ago
    Correct, I did not want to have any influence over the results of the "out of box" testing as many users on these platforms won't even know how to tweak the OS and Apache on a low level. But as mentioned, I will be making some of the suggested tweaks to ALL of the platforms and rerunning the tests and posting a follow-up on that as well. I will make sure everything is as uniform as possible. If there is anything specific I should be aware of please let me know, thanks! -Chad