4 ms·
Reliable benchmarking is hard. There are actual journals about measuring computer system performance. Some questions: * How is startup time controlled for? *
by jacques_chester 13y ago
Reliable benchmarking is hard. There are actual journals about measuring computer system performance.
Some questions:
* How is startup time controlled for?
* Why only one run?
* Why so few requests?
* Why no warmup period?
* Why this particular configuration?
* What is the OS, hardware configuration?
* Why is it running in a development environment instead of a test or prod environment?
- resca79 13y agoProd. The app is a very simple rails4 standard app iMac Intel Core 2 Duo 3,06 GHz cpu 1
- jacques_chester 13y ago=> Rails 4.0.0 application starting in development on http://0.0.0.0:3000
- resca79 13y ago.... update the gits .. thanks!
- ebonfortress 13y agoI would really like to see some articles about proper benchmarking procedures at 1000+ requests per second. Are there any?
- jacques_chester 13y agoThe ACM's SIGMETRICS[1] are the main group publishing this kind of research. Some of it gets very specialised -- just picking a title from the most recent Performance Evaluation Review[2], I get "YOUQMON: a system for on-line monitoring of YouTube QoE in operational 3G networks". However, being the ACM, it's basically inaccessible unless you sell a kidney. An organisation with a slightly more industrial focus is the Computer Measurement Group[3]. Like the ACM ... bring money. [1] http://www.sigmetrics.org/ http://www.sigmetrics.org/ [2] http://dl.acm.org/citation.cfm?id=2518025&CFID=252561427&CFTOKEN=88550832 http://dl.acm.org/citation.cfm?id=2518025&CFID=252561427&CFT... [3] http://www.cmg.org/ http://www.cmg.org/
- look_lookatme 13y agoSorry to go off-topic, but does anyone know if it's possible to get your hands on these pubs/journals for free at the Science, Industry and Business Library [1] in NYC? [1] http://www.nypl.org/locations/sibl http://www.nypl.org/locations/sibl