3 ms·

Thanks amarsahinovic for sharing this here. This is a brief blog entry with some observations about Round 3 of our web frameworks benchmark project. The commu

by bhauer 14y ago

Thanks amarsahinovic for sharing this here. This is a brief blog entry with some observations about Round 3 of our web frameworks benchmark project. The community contributions continue unabated and I think the impressively long charts demonstrate just how much the community has given us. Thank you to everyone who has participated and we are looking forward to Round 4 already! Please reply to let us know if you have any comments, questions, or criticisms. We'd love to hear your feedback.

kbd 14y ago
Would still like Ruby to be tested with app servers other than Passenger. Is this planned for Round 4?
- bhauer 14y ago
  Oops! Thanks for pointing that out. This is an oversight in the readme for the Ruby tests. They are on Unicorn for Round 3 [1]. We'll get the readme updated and the Environment Details clarified as well. [1] https://github.com/TechEmpower/FrameworkBenchmarks/blob/master/rails/setup_ruby.py https://github.com/TechEmpower/FrameworkBenchmarks/blob/mast... Edit: I've edited the Environment Details page accordingly.
  - kbd 14y ago
    This is the readme I looked at before I commented: https://github.com/TechEmpower/FrameworkBenchmarks/tree/master/rack https://github.com/TechEmpower/FrameworkBenchmarks/tree/mast... It still references Passenger.
orclev 14y ago
Really glad to see the performance of Yesod has moved up closer to where I'd expect now that some of the mistakes in the original benchmark have been fixed. One thing I do notice is that Yesod is using MySQL as the DB backend for the DB tests, but it does have support for MongoDB as well. Looked at from that perspective it's actually one of the higher performing frameworks for all the DB tasks, but it's hard to say for sure because it's never tested with MongoDB (it usually lands somewhere above all the MySQL based tests, but below all the MongoDB tests). Would be interested in seeing how it performs with the MongoDB backend used instead. Maybe if I get some time in the next couple weeks I'll try to swap out the backends and make a pull request.
- apkdn 14y ago
  The performance of Yesod isn't where I expect it to be. I'm actually quite disappointed. With client session disabled, I'd expect it to be close to the top along with some of the micro frameworks.

by bhauer 14y ago

kbd 14y ago

Would still like Ruby to be tested with app servers other than Passenger. Is this planned for Round 4?

bhauer 14y ago
Oops! Thanks for pointing that out. This is an oversight in the readme for the Ruby tests. They are on Unicorn for Round 3 [1]. We'll get the readme updated and the Environment Details clarified as well. [1] https://github.com/TechEmpower/FrameworkBenchmarks/blob/master/rails/setup_ruby.py https://github.com/TechEmpower/FrameworkBenchmarks/blob/mast... Edit: I've edited the Environment Details page accordingly.
- kbd 14y ago
  This is the readme I looked at before I commented: https://github.com/TechEmpower/FrameworkBenchmarks/tree/master/rack https://github.com/TechEmpower/FrameworkBenchmarks/tree/mast... It still references Passenger.

orclev 14y ago

Really glad to see the performance of Yesod has moved up closer to where I'd expect now that some of the mistakes in the original benchmark have been fixed. One thing I do notice is that Yesod is using MySQL as the DB backend for the DB tests, but it does have support for MongoDB as well. Looked at from that perspective it's actually one of the higher performing frameworks for all the DB tasks, but it's hard to say for sure because it's never tested with MongoDB (it usually lands somewhere above all the MySQL based tests, but below all the MongoDB tests). Would be interested in seeing how it performs with the MongoDB backend used instead. Maybe if I get some time in the next couple weeks I'll try to swap out the backends and make a pull request.

apkdn 14y ago
The performance of Yesod isn't where I expect it to be. I'm actually quite disappointed. With client session disabled, I'd expect it to be close to the top along with some of the micro frameworks.