3 ms·
> "The temperature is on a trajectory to breach the machine's operating limit in N minutes" seems pretty actionable. For who? For an application, the job will
by joshuamorton 7y ago
> "The temperature is on a trajectory to breach the machine's operating limit in N minutes" seems pretty actionable.
For who?
For an application, the job will just get rescheduled onto a different machine, and you're N+2 or whatever so no one will notice the restart.
For the datacenter, since (for most jobs) you can assume that no one will care, you don't necessarily monitor for single machines overheating, but rack or row level issues, if a machine keeps overheating, eventually "nothing runs on this machine for more than an hour without it restarting" -symptom based alerting kicks in and tells someone to look at the machine.