4 ms·
> Time for the obligatory xkcd again Which fails to consider that the ML outcomes fail on unreasonable structural misinterpretations, also explicit in the arti
by mdp2021 5y ago
> Time for the obligatory xkcd again
Which fails to consider that the ML outcomes fail on unreasonable structural misinterpretations, also explicit in the article (e.g. "with the wrong light the signal becomes a cat").
> Let's not forget that humans also make a lot of mistakes
Let's not forget that humans are completely, radically different - in terms of implemented modules.
An evaluation over reliability does not just come from test results: it also results from structural assessments.
Do modify for the progress of Science and Technology the throat of a dog to make it speak proper cockney: it will remain a dog, just don't be fooled; said «"progress"» is in term of "re-search", not of "re-sults" - you are still searching. Mind the direction, because if you tend to fool yourself that a puppet with a tape player in its mouth does speak, there is a problem.
- t_mann 5y agoAn evaluation over reliability does not just come from test results: it also results from structural assessments. Yes, but it's actually remarkable how bad humans are at seemingly simple tasks like recalling a short scene that they witnessed in person, or even just estimating how good their recollection is. Humans will routinely get even the most basic facts such as how many people were involved, who did what, in what order events occurred... completely wrong, while often being adamant that their account is correct. There are studies about that in the context of crime witnesses and the type of biases also mentioned in the article. A NN network might give a different answer if we apply some practically invisible Gaussian noise to an image, a human will have a different memory recollection depending on the lighting conditions of the room they're in, whether they're asked before or after lunch break... Again, I'm on board with saying that our standards for machines should be higher than that, but I think we're underestimating how hard those seemingly simple tasks are even for humans.
- mdp2021 5y agoWell, don't call hour human a Witness if you have not implemented the ReferenceArchive module, and don't call your ANN a Judge if you have not implemented the ActiveOnthology (Philosophy) module.