3 ms·
Aviation has a healthy blameless culture which has created willingness on the part of air crews to self-report deviations. If you make a mistake and own up to
by mulmen 3y ago
Aviation has a healthy blameless culture which has created willingness on the part of air crews to self-report deviations. If you make a mistake and own up to it you suffer no consequences. Keeping recordings forever may disincentivize crews from communicating freely if their comments could come back to haunt them years later. This may still be a good idea but it’s not as simple as changing the retention period on recordings.
- DrNosferatu 3y agoOnly warrant-issued-by-judge-mandated disclosure. Full privacy preservation.
- mulmen 3y agoAviation is safe because the participants all trust each other. Blanket recording for undefined future use undermines that trust. This has a chilling effect on communication. Crews will be reluctant to communicate with each other. The risk of a warrant being issued at all creates an adversarial relationship between crews and investigators. This is a horrible idea and suggesting it betrays a cliche misunderstanding of the domain that is the stereotype of modern technologists.
- donmcronald 3y agoYes, the blameless culture is a critical safety feature and it could be ruined very easily if the failed leadership in the industry starts looking for scapegoats. It's sad too because analyzing every cockpit conversation with AI to highlight things that may cause common confusion could be invaluable. Instead, the short-sighted leadership in today's business world will use it for (job) performance analysis and to penalize workers for failing to act like robots :-(
- mulmen 3y agoPossibly. But as a technologist I don’t trust AI to actually deliver such a result in our generation. The system will inevitably be created by modern technologists without intimate domain knowledge. It will be motivated by short-term deadline chasing and MVP culture. The cockpit of an airliner is no place for bleeding edge technological innovation. I don’t need an Airbus with Siri. Pilots already spend hours in training every year. Is reviewing the output of this AI system really a better use of their time? What problem is it even solving?
- kelseyfrog 3y agoWhat would it take to make you trust AI?
- mulmen 3y agoDecades of development and successful deployment first in non-safety-critical settings then further demonstration in progressively higher stakes environments. In addition demonstration that the technology has any benefit to this domain at all. My concerns have more to do with the technology industry than AI itself. AI is a buzzword and the technology as it exists is of dubious benefit here. We have an unhealthy tendency to deploy technology too early and for the wrong reasons. These are undesirable impulses in aviation.
- kelseyfrog 3y agoThank you for your honesty. Are there any other industries that you hold at a similar standard?
- rlpb 3y agoI can't speak for GP, but "safety critical" is the term relevant to this thread I think. Any situation where people die if you screw up, where that includes screwing up at a higher level, such as introducing ill-thought-out process changes.
- kelseyfrog 3y agoThank you. That's a good grounding that helps orient toward what I feel is being conveyed. I sense there's a lot of overlap with SCADA-enabled infrastructure: transportation, nuclear, industrial control, &c. And we should be hesitant to deploy AI in those environments. Am I getting that right?
- Aeolun 3y agoAnalysing cockpit voice recordings for confusing terms (using AI or not) does not strike me as something that would affect the operation of the aircraft in any shape or form?