4 ms·
> You don't need to live in some company's digital ecosystem. I don't. I own my own photos, and Apple are not getting any facial recognition features out of the
by batty_alex 8y ago
> You don't need to live in some company's digital ecosystem. I don't. I own my own photos, and Apple are not getting any facial recognition features out of them.
Workers, patients, and customers don't get this choice. I work on hospital systems that use "AI" and we wouldn't survive a proper code audit for what we claim saves lives. We get audited by the FDA, but they aren't combing through our code - just the documentation that we write.
Sure, we describe the algorithms put together by our researchers, but even the rank-and-file developers mostly just consume the algorithms that decide what to tell Doctors taking care of the patients.
For now, at least, Doctors and Nurses mostly use our software as a retrospective tool. I know we're not selling it that way and I worry about the day folks are using this system in place of their years of experience.
The statistics we put out say our software is x% better than the Doctor at making these decisions, is that true? Who knows, but an audit to make sure we're not selling snake oil might save lives.
> Everything that does anything is an algorithm. Will we have to get government authorisation before we can quicksort?
This just sounds like a strawman argument. If you say, 'our proprietary algorithm will save thousands of lives from malpractice,' you better be ready to back that up with an audit. It better not be a bridge that's going to fall apart when an eighteen wheeler travels across it for the first time.
- riskneutral 8y agoA code-level government audit of all life-critical software sounds impractical. There are already millions of lines of code in production on FDA approved devices (e.g. pacemakers?) so I am sure that standards and certification processes around this already exist.