4 ms·
600 requests per second for a hello world not even hitting a database? Are the units right? Shouldn't it be in kilo-requests per second?
by pkolaczk 6y ago
600 requests per second for a hello world not even hitting a database? Are the units right? Shouldn't it be in kilo-requests per second?
- indemnity 6y agoSeems low, yes. I get~500k RPS when running Rust API servers returning JSON on WSL2 on Windows. (No DB, DB calls decreases that 10x).
- jiggawatts 6y agoAs a point of reference, I once wrote an ASP.NET application in 2005 that could easily put out 2000-3000 full-text search result web pages per second... on a 2-core laptop. These days .NET Core 5 is challenging Rust in the web server rankings, so anything less than 10K RPS is a failure... somewhere.
- pkolaczk 6y agoPretty much matches my experience of Rust + Cassandra on a Linux laptop (I get ~250k req/s without database, ~50k with updates).
- jiggawatts 6y agoApp Service will fail any benchmark you throw at it, which is why this guy will get a letter from Microsoft's lawyers pretty soon. Just like with Oracle Database, benchmarking the Azure Cloud is verboten, especially their PaaS services. Azure App Service has a networking stack that I would categorise as a "hot pile of steaming garbage": It is insanely, unbelievably, almost hilariously slow. Even internally they VPN-tunnel, they NAT, and then they then do some unnecessary L7 stuff. If you can talk to App service in under 3ms, then you're lucky. Heaven help you if you've made the mistake of separating out an "API tier" or any such thing. Using Azure SQL Database is iffy also, but no worries, support will helpfully tell you how to improve your latency from an IaaS VM... which is not what you're using if you're using App Service.
- jamra 6y agoWe get 500 req /sec hitting a non trivial database load.