3 ms·
Great write up! The use of coefficient of variation to detect instability seems reasonable. I've been done performance analysis of actual request traffic (not f
by atombender 1y ago
Great write up! The use of coefficient of variation to detect instability seems reasonable. I've been done performance analysis of actual request traffic (not for benchmarking) to gauge the level of noise in a noisy-neighbor environment, and I believe I looked into using CoV for this and found it wasn't particularly reliable for my purposes.
I'd love to learn about more statistical techniques for doing such analysis. For example, one thing I looked into was correlating tenants and identifying a likely culprit, and it's often not just a matter of absolute request volume. If multiple tenants' latencies increase at once, it's usually because one of them started doing something. But its hard to isolate what that is, when there are many different types of workloads with unpredictable performance impact.