5 ms·
What would be representation of some real work scenarios? I think their test suite covers wide spectrum of operations enough so to be able to draw conclusions f
by Hnus 5y ago
What would be representation of some real work scenarios? I think their test suite covers wide spectrum of operations enough so to be able to draw conclusions from them.
https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#fortunes https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Proj...
- fenring 5y agoUnfortunently, after looking at the .net core implementation of this benchmarks, I wouldn't trust it at all. The code is just overengineerd to perform best at benchmark - everything hardcoded, custom routing to cover 2-3 routes with minimal overhead etc. It has nothing in common with real world code.
- The_rationalist 5y agoThe rust and c++ implementations are only on the top 10 because they use PostgreSQL pipelining/batching
- the_duke 5y agoThe Techempower entries are heavily gaming the system. They often strip out framework functionality and hyper-optimise for the specific benchmark, including things like pre-allocating the exact amount of memory needed to serve the request, not doing route matching et all, etc. They are basically an exercise in "how clever can we be to win the benchmark" rather than a realistic portrait of real world performance.
- fabian2k 5y agoat least for .NET the versions that strip out framework functionality are marked separately, though this part is not that easy to understand if you don't know about it. There are several .NET entries from very low-level without MVC and without ORM up to the full stack. But still, these benchmarks have their uses but there are a lot of caveats you need to consider when looking at the results.