4 ms·
One of the neat parts of expert systems was that you could get surprising and bizarre interactions between rules, leading to entertainingly nonsensical answers.
by mcguire 9y ago
One of the neat parts of expert systems was that you could get surprising and bizarre interactions between rules, leading to entertainingly nonsensical answers.
One of the neat parts of neural networks is that you have no idea what rules it's using, but it still manages to produce answers that are sometimes not entertainingly nonsensical.
- jacquesm 9y agoThe bigger problem is that they produce that are most of the time making perfect sense and then every now and then they spectacularly fail on input that is indistinguishable from inputs that gave correct answers.
- nartz 9y agoWell, as referenced in my above comment - you could spend the time to figure out how the prediction was made. Specifically, decoding the training process and what data points were used to influence the prediction - but it would be complicated and take a lot of your time. It might give you more clues why something like random noise was classified as a hot dog.
- empath75 9y agoI think this also happens in the human brain quite a bit. There’s a lot of times where you see something out of the corner of your eye that isn’t there, or you duck because you think something was coming towards you, or you wave because you think you recognize someone. I bet at a lower level, various systems in the mind fail constantly but we have enough redundant error correction to filter it out.
- lowbloodsugar 9y agoIt's funny that we are willing to disqualify an AI as an I simply because it comes to some startlingly nonsensical result, yet history is full of humans doing the same thing (from placing a plastic cup on a hot stovetop through to gas chambers).
- nartz 9y agoHa - the thing to think about here is, pretend that you were asked a question of say, why you labeled a horse picture as a horse. You might say something like "well, it has hoofs, and a mane, and a long snout, and 4 legs, etc". However, that sort of answer from a computer would probably be labeled as too generic since that could be any number of animals. The issue is, that to you a horse is some complicated 'average' of all the examples of horses you've seen in your lifetime, that go through a complicated mechanism for you to classify it. Specifically, probabilities of different features that your eyes have extracted from seeing them. Similarly, understanding why a neural network is doing something is very possible, however, it fails to mean much when the answer it could give is a list of, say, hundreds of vectors and weightings that contributed to its prediction.