4 ms·
If school grades are indicative, even a 90% accuracy is commendable for human driven tasks. The big difference is that when a human double checks their own work
by BlackFly 6y ago
If school grades are indicative, even a 90% accuracy is commendable for human driven tasks. The big difference is that when a human double checks their own work, they may not make the same mistake twice. Or even better, when a second person checks the work.
Mistakes are tolerable, but you need to be able to recover from them somehow, and recovery from an AI mistake seems to be something that people like to pretend is unnecessary or impossible.
We currently live in a world where failures are tolerable but seem adamant that moving to an AI driven world means that failures are no longer tolerable. We still haven't lost the ability to make mistakes (because we still do many things manually) but we really seem keen on losing it.
- gbear605 6y agoSchool grades are testing something very different from data entry. We know as a species that our learning process is slow and error prone, so doing decently at that is good, and we don’t need to have 100% knowledge in a school subject. Meanwhile, yes, if my bank is copying account values, or even just account ledgers with history, I want them to have 100% accuracy. Not 99.99999% or 99.9% or 99%, let alone 90%.
- partyboat1586 6y agoTrain two AIs and have them check each others work. This must have been done already? No?
- csours 6y agohttps://en.wikipedia.org/wiki/Generative_adversarial_network https://en.wikipedia.org/wiki/Generative_adversarial_network
- mcherm 6y agoAre you training the two AIs on the same data set? If so, won't they be likely to make the same sorts of errors rather than making different errors and thus providing an effective check on each other?
- partyboat1586 6y agoGood point, you would have to train them on separate data sets. I wonder how the error rate would differ from training one model on all the data.
- csours 6y agoIf I get 90% of my math correct on a test, that's great! If I get 90% of my math correct while engineering a rocket, that's terrible!
- deleted 6y ago[deleted]
- MattGaiser 6y ago> If school grades are indicative, even a 90% accuracy is commendable for human driven tasks. School grades are in an environment where you learned it recently, have no access to references, and have not been doing it very long. If you had to keep doing algebra for even a month on a full time basis, you will get a lot better than 90%.