3 ms·
Disclaimer: PHP core dev. Be careful with microbenchmarks. From my experience, there tends to be very little correlation between performance improvements on mi
by nikic 9y ago
Disclaimer: PHP core dev.
Be careful with microbenchmarks. From my experience, there tends to be very little correlation between performance improvements on microbenchmarks and real applications. If you improve performance on the microbench suite by a factor of two, you definitely will not get a factor of two on real applications -- more likely, it will be something like 2%.
Basically, if the benchmark is not testing end-to-end performance on Wordpress (or similar), then it's a useless benchmark.
- TazeTSchnitzel 9y agoThe classic example of this would be that, before PHP 7, Zend spent a lot of effort trying to make PHP use JIT. It improved the results on microbenchmarks a lot, but made negligible difference to real-world code, IIRC.
- jakubmisek 9y agoGood point. In case of Peachpie microbenchmarks - that time it was the only pieces code that could be compiled ... We'll try to update benchmarks for more complex solutions.