5 ms·

I am planning a big ruby benchmarking blog post in the next week or so. I will definitely add Jubilee to the existing list of rack servers to test with!!!

programminggeek 13y ago
Right now I plan on testing rails, sinatra, cuba, plain rack, probably the frameworks previously benchmarked here: https://github.com/luislavena/bench-micro https://github.com/luislavena/bench-micro I plan on benchmarking on thin, unicorn, puma, WEBrick, torquebox 3, torqbox (torquebox 4), trinidad, passenger, and I guess now Jubilee. I was also thinking of doing some EventMachine based stuff like goliath and whatever else I can find in that space. From my early benchmarks last weekend torqbox is the fastest and pure rack is a lot faster than sinatra or rails. Sinatra is not nearly as fast as I thought it was compared to pure rack. A simple thin server running ruby 1.9 got about 1500 req/sec for hello world using Sinatra. Torqbox and jruby brought that to about 5000 req/sec. Plain rack was about 6500 req/sec on ruby 1.9 and thin and on torqbox it was 10,250 req/sec. For reference, my golang hello world was getting 10,500 req/sec. I'm very curious where Jubilee will land in that mix.
- knotty66 13y ago
  For your golang test did you have GOMAXPROCS set to the number of CPU cores in your system?
  - programminggeek 13y ago
    Yep, I did. I'm sure they are some fiddly bits that could have driven it a little higher, but if you look at the tech empower latest bench, the torqbox json rack test is within spitting distance of golang, so I don't think my results are that far off.
    - knotty66 13y ago
      Cool, that's pretty impressive.
- mrinterweb 13y ago
  One more ruby framework that might be interesting to test would be grape. https://github.com/intridea/grape https://github.com/intridea/grape Thanks for the work you've done with bench-micro. I was not aware of all of those frameworks.
  - programminggeek 13y ago
    I can't take credit for bench-micro, but I was also really excited when I found it. And yes I'll add grape to the list.
- bigbento 13y ago
  I'd be curious as to where Reel (both on and off Rack) lands in there as well.
- nwienert 13y ago
  Would be really cool to see it tested on the various ruby runtimes as well (rubinius, jruby, MRI 2.0-2.1)
  - programminggeek 13y ago
    Yep that's the plan!
- bascule 13y ago
  Be sure to check out Reel: https://github.com/celluloid/reel https://github.com/celluloid/reel
  - programminggeek 13y ago
    Oh fun, I'll have to add that to the list.
jt009 13y ago
Why even bother? Just approximate with "it's slow" and call it a day.

programminggeek 13y ago

Right now I plan on testing rails, sinatra, cuba, plain rack, probably the frameworks previously benchmarked here: https://github.com/luislavena/bench-micro https://github.com/luislavena/bench-micro I plan on benchmarking on thin, unicorn, puma, WEBrick, torquebox 3, torqbox (torquebox 4), trinidad, passenger, and I guess now Jubilee. I was also thinking of doing some EventMachine based stuff like goliath and whatever else I can find in that space. From my early benchmarks last weekend torqbox is the fastest and pure rack is a lot faster than sinatra or rails. Sinatra is not nearly as fast as I thought it was compared to pure rack. A simple thin server running ruby 1.9 got about 1500 req/sec for hello world using Sinatra. Torqbox and jruby brought that to about 5000 req/sec. Plain rack was about 6500 req/sec on ruby 1.9 and thin and on torqbox it was 10,250 req/sec. For reference, my golang hello world was getting 10,500 req/sec. I'm very curious where Jubilee will land in that mix.

knotty66 13y ago
For your golang test did you have GOMAXPROCS set to the number of CPU cores in your system?
- programminggeek 13y ago
  Yep, I did. I'm sure they are some fiddly bits that could have driven it a little higher, but if you look at the tech empower latest bench, the torqbox json rack test is within spitting distance of golang, so I don't think my results are that far off.
  - knotty66 13y ago
    Cool, that's pretty impressive.
mrinterweb 13y ago
One more ruby framework that might be interesting to test would be grape. https://github.com/intridea/grape https://github.com/intridea/grape Thanks for the work you've done with bench-micro. I was not aware of all of those frameworks.
- programminggeek 13y ago
  I can't take credit for bench-micro, but I was also really excited when I found it. And yes I'll add grape to the list.
bigbento 13y ago
I'd be curious as to where Reel (both on and off Rack) lands in there as well.
nwienert 13y ago
Would be really cool to see it tested on the various ruby runtimes as well (rubinius, jruby, MRI 2.0-2.1)
- programminggeek 13y ago
  Yep that's the plan!
bascule 13y ago
Be sure to check out Reel: https://github.com/celluloid/reel https://github.com/celluloid/reel
- programminggeek 13y ago
  Oh fun, I'll have to add that to the list.

jt009 13y ago

Why even bother? Just approximate with "it's slow" and call it a day.