3 ms·
This is a good guide. One thing I'd add: While you're monitoring for traffic/errors/latency throw in minimum success rate. Make a good estimate of how many suc
by bcoates 7y ago
This is a good guide. One thing I'd add:
While you're monitoring for traffic/errors/latency throw in minimum success rate. Make a good estimate of how many successful operations monitored systems will do per minute on the slowest hour of the year and put in an alert if the throughput drops below that. You'd be surprised how many 0 errors/0 successes faults happen in a complex system, and a minimum throughput alarm will catch them.
- mkeedlinger 7y agoIn some systems it's also nice to have a "canary" acting as the user to call your API every minute or so. Then even during low / no traffic hours you can still catch errors/outages/etc.
- lrem 7y agoThat's a prober, not a canary.
- nitrogen 7y agoSometimes things can be described in more than one way. Canary, readiness probe, health check, heartbeat, etc. It makes communication more efficient and enjoyable when all parties are aware of this.
- lrem 7y agoYes, there are many words in the space. But there are also many classes of systems. It makes communication more efficient and enjoyable if all parties can think of the same thing when hearing a word.
- deleted 7y ago[deleted]