3 ms·
The techmeme results are not representative of the framework as they report extremely high error rates in their results. We don't know what caused the errors an
by chrismccord 10y ago
The techmeme results are not representative of the framework as they report extremely high error rates in their results. We don't know what caused the errors and unfortunately we didn't have a chance to collaborate with them on a true run as they didn't publish their preliminary results like they normally do before the final set. A few months ago they added Phoenix in a preview, but it was a very poor implementation. They were testing JSON benchmarks through the :browser pipeline, complete with crsf token generation. They had a dev DB pool size of 10, where other frameworks were given of pool size of 100. And they also had heavy IO logging, where other frameworks did no logging. We sent a PR to address these issues, and I was hoping to see true results in the latest runs, but no preview was provided this time and we weren't able to work with them on the errors.
tldr; these results are not representative of the framework.
- merb 10y agoactually no framework in techempore is a representative of the framework. also the test cases say nothing about the real performance either.
- brightball 10y agoThanks for clearing that up! Now I'm excited again.