4 ms·
> 99.999 is miserable to support. how do you even get the granularity to measure, freedom to try anything? i dont think cloud services even provide slas like th
by tasn 4y ago
> 99.999 is miserable to support. how do you even get the granularity to measure, freedom to try anything? i dont think cloud services even provide slas like that for their services.
A lot of redundancies and testing.
> 1 billion a year would average out to 32 a second. if its 10 billion? 320/second. surprising to see rust for this. gc languages should be able to handle it.
This assumes even distribution, though traffic is much much more spiky than this. We started with Python and switched to Rust. FWIW, Rust is great for many other reasons, not just the efficiency. For example, we absolutely love the type system.
> would have been interesting to see how much fragmentation there is. reads like there was a debugging step missing.
I'm not the engineer that did the investigation, so can't comment directly about what he checked. Maybe it's not written there, but he also measured allocator statistics and indeed saw that the memory used according to the US was much higher than what the allocator stats said.
- tayo42 4y agoOh maybe I missed but I didn't think that info was there. Would have been interesting to see thr extent of fragmentation or what the cause was. 5 9s of uptime means 800ms of down time a day. Is this not in a cloud, a load balancer health check can't react that fast. Vms will get randomly killed if something is wrong.
- tasn 4y agoThe SLA is monthly, not daily.
- tayo42 4y agothat's still like 30 seconds. <1 of 100,000 requests ever failing. im surprised the company finds the tradeoff of providing that worth the engineering cost to attempt to provide something like that.
- harpiaharpyja 4y agoYet again, averages don't always represent real life accurately.
- tayo42 4y agotheyre usually close enough, especially for estimating needs. 1 billion/year averages out to 30/second like i said before. You think they're bursting to 1000? maybe i could believe that. 10,000?100,000/second? its unlikely. this is all still scale that is handled by stable, gc languages.
- drogus 4y agoSpeed is not the only advantage of using Rust on the backend.