5 ms·
Some people, when confronted with a problem, think “I know, I'll send an email whenever it happens.” Now they have two problems.
by tantalor 13y ago
Some people, when confronted with a problem, think
“I know, I'll send an email whenever it happens.” Now they have two problems.
- rmc 13y ago"What if the email goes down? I know I'll send an email"
- mafro 13y agoKeyboard missing, press F1 to continue
- dredmorbius 13y agoThat's actually a case where sending a regular ping mail to several sentinal systems which report on the LACK of an email can be useful. Reminds me of a few times the email queues got backed up to hell and beyond. Fuck you, Yahoo.
- marcosdumay 13y agoI really don't get where you are going with that. Are you arguing that alerts are useless, and we must fix the issue for once? Because if so, I'd point that some things can not be fixed (because the Earth is finite, we don't know all things, etc) and you are better alerted sooner, rather than later. Now, if you are arguing that email is not the right medium for an alert, well, what medium is better? Really, I can't think of any single candidate. Yeah, email may go down, that's why you complement it with some system external to your network (a VPS is cheap, a couple of them in different providers is almost flawless, and way cheaper than any proprietary dashboard). Yes there is some delay involved, that should be of a few minutes at most, because you create some addresses specifically for the alerts, and make all hell break loose then a message gets there. Some standard IM protocol that federated between all your net (and external point of control), could be reached from anywhere, and had plenty of support on all kinds of computers would be better, but it does not exist.
- rhizome 13y agoSome standard IM protocol that federated between all your net (and external point of control), could be reached from anywhere, and had plenty of support on all kinds of computers would be better, but it does not exist I would recommend an SMS sent via GSM modem for out-of-band emergency notifications.
- tobych 13y agoOr a service like Twilio, with an HTTP API for this.
- alister 13y agoI got the GP's point immediately: He means that system administrators already get an enormous volume of email. Send them another email and it'll get ignored, deleted, or put at the bottom of a gigantic to-do list. For airline pilots, an excessive number of warnings themselves (bells, alarms, audible warnings) are known to distract the pilots and cause errors.
- aryastark 13y agoI think you're being obtuse. Once you start sending emails for things, you start sending emails for everything. It's easy to fall into the trap of not accurately categorizing what is critical (like real, real, critical, I mean it this time guys!) and what are merely statuses. So what happens is everything starts being ignored, and your systems become obscure black boxes again.
- hueving 13y agoI think you were the one being obtuse. There is no assumption that you will start receiving useless email status updates. In fact, most reasonable monitoring tools only email when a status changes to a problem state.
- dredmorbius 13y agomost reasonable monitoring tools 20+ years of experience tells me most monitoring tools aren't reasonable.
- dredmorbius 13y agoHospitals have a similar problem -- too many devices with too many alarms. As many as 10,000/day in a busy nursing floor. NPR covered this a few days back, I've written on it at more length: http://www.npr.org/blogs/health/2014/01/24/265702152/silencing-many-hospital-alarms-leads-to-better-health-care http://www.npr.org/blogs/health/2014/01/24/265702152/silenci... http://www.reddit.com/r/dredmorbius/comments/1x0p1b/npr_silencing_hospital_alarms_results_in_better/ http://www.reddit.com/r/dredmorbius/comments/1x0p1b/npr_sile...