4 ms·
>> ...AI systems whose actions cannot be closely scrutinized and explained... > Author is one of the large group of people who are in for a shock > when th
by pmoriarty 7y ago
>> ...AI systems whose actions cannot be closely scrutinized and explained...
> Author is one of the large group of people who are in for a shock
> when they try to scrutinize and explain a humans crazy actions. I
> can't even explain why I get the wrong result sometimes when I add
> numbers in my head.
I was just rereading Asimov's I, Robot, and was struck by this passage:
"The cotton industry engages experienced buyers who purchase cotton. Their procedure is to pull a tuft of cotton out of a random bale of a lot. They will look at that tuft and feel it, tease it out, listen to the crackling, perhaps, as they do so, touch it with their tongue, and through this procedure they will determine the class of cotton the bales represent. There are about a dozen such classes. As a result of their decisions purchases are made at certain prices, blends are made in certain proportions. Now these buyers can not yet be replaced by the machine.
"Why not? Surely the data is not too complicated for it?
"Probably not, but what data is this you refer to? No textile chemist knows exactly what it is that the buyer tests when he feels a tuft of cotton. Presumably there's the average length of a thread, their feel, the extent and nature of their slickness, the way they hang together and so on. Several dozen items, subconsciously weighed out of years of experience. But the quantitative nature of these tests is not known. Maybe even the very nature of some of them is not known. So we have nothing to feed the machine. Nor can the buyers explain their own judgment. They can only say, 'Well, look at it. Can't you tell it's class such and such?'"
Asimov wrote this in the 1940's and in this passage he tried to illustrate how unquantifiable and impenetrable human judgment was compared to artificially intelligent robots, which he saw as ultimately rational calculating machines. Ironically, today AI techniques such as neural networks are criticized for making much the same sort of impenetrable judgments.
- aidenn0 7y agoAsimov also assumed we wouldn't have AI at all if we couldn't mathematically prove certain things about it, and instead we are handing over deadly tasks to AI without any knowledge of how it works.
- galaxyLogic 7y agoYes Asimov assumes AI would be based on logic, he was not aware of neural networks which I think had not been discovered yet. It should have been clear though that if we grow brains in vats they might resemble human brains greatly.
- inertiatic 7y agoWell, these things would still need to be represented as features, or some sort of input to perform feature extraction on, and we might still not know what that input is. It hasn't aged that badly.
- Animats 7y agoCotton classification automation.[1] "USDA’s classing methodology is based on both grade and instrument standards used hand-in-hand with state-of-the-art methods and equipment. The system is rapidly moving from reliance on the human senses to the use of high-volume, precision instruments that perform quality measurements in a matter of seconds." [1] https://www.cottoninc.com/cotton-production/quality/classification-of-cotton/overview/ https://www.cottoninc.com/cotton-production/quality/classifi...
- PeterisP 7y agoThe key part here is the statement "So we have nothing to feed the machine" which, as we now know, has turned out to be false. We don't need people to be able to tell you how and why they made that decision, we can treat the human decision-makers as a 'black box' and learn to effectively copy the behavior of that black box without necessarily needing to understand how and why it makes these decisions. We don't need textile chemists to know exactly what it is that the buyer tests when he feels a tuft of cotton if we can replicate the process of "subconsciously weighed out of years of experience" by having a machine look at enough expert decisions that amount to literal years of experience.
- pts_ 7y agoThis is called being blindsided by ego. There is nothing special about the human brain. It's a mechanical device cycled through evolution, which has probably happened countless times in the universe. If we make an AI which is to the human brain as a fighter jet is to walking, we would just contributing to that evolution.