3 ms·
Human errors are more likely, but they are fairly well understood and you can safeguard yourself by putting more people higher up the stack checking things. Th
by stickfigure 10y ago
Human errors are more likely, but they are fairly well understood and you can safeguard yourself by putting more people higher up the stack checking things.
This doesn't sound true to me. The worst man-made catastrophes seem to frequently involve a human manually disabling some sort of critical safety mechanism (eg, Chernobyl). You could look at the checklist as a primitive form of automation that helps precisely because it removes human judgement.
In theory, automation could encompass the knowledge of the finest experts in the field. Humans get credit for being able to think flexibly and accommodate information that maybe wasn't included in the original programming. But if you're experiencing a six-sigma event that the system wasn't programmed for, what is the chance that Joe Random Operator (completed a two-month training certificate program) is going to be savvy enough to respond better?
- kbenson 10y ago> The worst man-made catastrophes seem to frequently involve a human manually disabling some sort of critical safety mechanism (eg, Chernobyl). But again, we're back to perverse incentives. Keeping the plant running was more important than diagnosing and fixing any problems. If the people involved were first assessed by how well they found and fixed problems, and then by how much uptime the plant had, I'm confident it would have played out quite differently. There is a point to what you're saying though, and how it interacts with my statement. Humans work based on current incentives, while machines work towards the goals their designers were incentivized towards at the time of their creation. Keeping the former in good order over time is a harder task than making sure the latter is correct at design time. That is, it's easy in the design process to emphasize the cost of errors and try to account for them, but humans managers, being more dynamic, sometimes allow perverse incentives to change how a human workforce behaves accidentally. Human workers are more versatile, but that versatile comes with downsides. > In theory, automation could encompass the knowledge of the finest experts in the field Which is why I qualified my statement with "until every mistake that can happen is known and accounted for" and "allow for". The point is, how many machines are operating in an environment where that's true, and we're actually utilizing the information from all the experts correctly? Just taking into consideration that the physical environments where machines run is often not fully under control, I think it's actually rather small.
- bluGill 10y agoIn the case I'm thinking of the company wanted maximum profit - which meant shutdown production when things failed, but continue until then. However there was a cowboy attitude: the operators knew that "Bubba" was almost able to to continue operation in a similar situation in the 1950s, and they think they are better. The reality is that "Bubba failed, but the catastrophic explosion was after 1 hour 20 minutes or some such thing, beating that record gives you bragging rights in the lunch room.
- kbenson 10y ago> In the case I'm thinking of the company wanted maximum profit - which meant shutdown production when things failed Sure, and I don't dispute that things like this happen. I'm just saying that the real problem here is "the company wanted maximum profit - which meant shutdown production when things failed, but continue until then" portion. Automation often doesn't allow this, not by design, but because it just can't, because it's not versatile enough to work around it's fairly narrow programming. Humans can, and when they do and then there's a major failure, that's not a problem of the human workers, or even entirely the problem of middle management, but of the overall policies and incentives that allow or promote such behavior. That is, automation is better at reducing errors, but I also think a lot (but not all!) of what we attribute to automation reducing errors is also just their inflexibility not allowing managers to go for short-term goals at the expense of long-term goals. It's like a car that refuses to drive more than 5 miles without needing to shut down for a couple minutes after it's been 3,200 (for some leeway) miles since the last oil change. It would force people to get oil changes more regularls, and while it would cost a little more for those that put it off far longer than they should (me), it saves money in the long run through the problems it prevents (and gets detected early be people looking under the hood). That doesn't mean people can't make sure to change it on time without that extra problem, it's just that we're generally pretty bad at quantifying risk, especially over longer time scales. That problem is mitigated somewhat by multiple people and a policy, so it's not a personal decision, which is why I think companies can do much better with humans as workers than they generally currently do, even if automation in the end yield less errors (but at the cost of flexibility in the system).