5 ms·
Copilot will cause deaths. Bad staff will rely completely on it when it works and not understand why, push stuff out and it will do "unexpected" things in their
by gxt 4y ago
Copilot will cause deaths. Bad staff will rely completely on it when it works and not understand why, push stuff out and it will do "unexpected" things in their eyes, but it will be too late for the dead.
- mrkramer 4y agoIn the short term maybe but in the long term everything will be automated just like there is flight autopilot or self-driving cars which are just getting started but yet they are very good at driving. Fault tolerance mechanisms will be implemented in all automated systems.
- gxt 4y agoThose are well designed systems in heavily regulated markets that go through extensive testing phases. Equating copilot with that is a mistake.
- mrkramer 4y agoBut that well designed systems are run on software. And there are security standards and compliances which they need to satisfy. I don't see a reason why something like GitHub Copilot wouldn't be subject to security standards and compliances.
- gxt 4y agoIt's not theoretically impossible, yes. It's going to happen at the same time as when requirement gathering is going to be perfect and doable by a computer. In practice, I see this happening, at the same time as AGI, because it's the same problem. As of today, copilot, FSD, and the like are just smoke and mirrors, pretending to be something much more capable than they actually are. This deception is what makes them so dangerous.