4 ms·
With AlphaGo in 2015 we crossed an important bridge in the Turing Test - before AlphaGo, we could be pretty certain that a high level Go game was played by a hu
by roenxi 7y ago
With AlphaGo in 2015 we crossed an important bridge in the Turing Test - before AlphaGo, we could be pretty certain that a high level Go game was played by a human. After AlphaGo, we can't be sure.
At this point a display of great competence no longer means that a human did it. Sure; all the parts haven't been completely connected to make self driving cars, general game playing AIs or conversation bots. But on any discrete task it is no longer reasonable to say "computers can't possibly do that" the way I could about a Go game between two 9 dan players in 2010.
I can still say "not commercially viable" and I can point to specific attempts that don't work, but computers are now on the same threshold as humans - [data + time = results]. It may be more data and more time than a human, but that is a big change from [logically modelled domain = results] which is where we were before in AI.
> ...AI systems whose actions cannot be closely scrutinized and explained...
Author is one of the large group of people who are in for a shock when they try to scrutinize and explain a humans crazy actions. I can't even explain why I get the wrong result sometimes when I add numbers in my head.
- sounds 7y agoI've only got a minute, but I think it was helpful for me to look at ML achievements in terms of input, output, and difficulty. A human brain can learn to recognize cat pictures given a relatively small amount of input versus a convolutional neural net. A human brain hits a limit somewhere in terms of attention span, though - I used this to understand AlphaGo's accomplishment. AlphaGo is not inherently better at solving complex problems compared to a human brain, but it is demonstrably better at focusing on one complex problem until it has amassed the equivalent of thousands of years of training. I'd guess that the human inability to concentrate on one problem that long is actually a clue. Humans come up with new go and chess insights continually. Maybe it's because we're bad at evaluating the new ideas objectively for such complex problems, but it may also be a clue that the human brain has a more efficient method to develop new ways of analyzing complex problems. The best machine-based deep learning approaches still need to crunch through an enormous data set. Especially so for unsupervised learning.
- thfuran 7y ago>A human brain can learn to recognize cat pictures given a relatively small amount of input versus a convolutional neural net To give the ANN a fair go, I think you should pretrain on another dataset while evolving the architecture. Let that chug for, say, 500 million years. Then refine its performance on your cat dataset and see how long it takes for that step.
- russdill 7y agoI think there's another level of representation that needs to happen for NNs to learn the appearance of an object in a similar way that humans do. I've seen a lot of research recently on compressed representations, I think applying that to object recognition might yield some interesting results.
- PeterisP 7y ago"A human brain can learn to recognize cat pictures given a relatively small amount of input versus a convolutional neural net." is not really accurate, this is an apples and oranges comparison. A human brain that's already learned to see and recognize objects can learn to recognize cat pictures from a small amount of input data, and a neural network that's trained to see and recognize objects (which explicitly didn't include cats) can also learn to recognize cat pictures from the same amount of input data. One-shot learning or few-shot learning is a thing and gets reasonable results. And a human brain that's learning to see "from scratch" (i.e. infants) can't learn from a few pictures, it needs huge amounts (many months) of rich image data - i.e. not passive but interactive/experimental, which is known to be neccessary for visual system development in mammals (I recall a bunch of cat experiments) and is known to have much, much better sample efficiency for artificial systems. So as far as I know there's no good reason to assume that human brain can learn cat pictures from less input than neural networks. What we're seeing and misattributing to the "learning capabilities" here is actually the effectiveness of transfer learning, transferring knowledge and skills everyone's learned as a kid to new (but actually very related) problems.
- pmoriarty 7y ago>> ...AI systems whose actions cannot be closely scrutinized and explained... > Author is one of the large group of people who are in for a shock > when they try to scrutinize and explain a humans crazy actions. I > can't even explain why I get the wrong result sometimes when I add > numbers in my head. I was just rereading Asimov's I, Robot, and was struck by this passage: "The cotton industry engages experienced buyers who purchase cotton. Their procedure is to pull a tuft of cotton out of a random bale of a lot. They will look at that tuft and feel it, tease it out, listen to the crackling, perhaps, as they do so, touch it with their tongue, and through this procedure they will determine the class of cotton the bales represent. There are about a dozen such classes. As a result of their decisions purchases are made at certain prices, blends are made in certain proportions. Now these buyers can not yet be replaced by the machine. "Why not? Surely the data is not too complicated for it? "Probably not, but what data is this you refer to? No textile chemist knows exactly what it is that the buyer tests when he feels a tuft of cotton. Presumably there's the average length of a thread, their feel, the extent and nature of their slickness, the way they hang together and so on. Several dozen items, subconsciously weighed out of years of experience. But the quantitative nature of these tests is not known. Maybe even the very nature of some of them is not known. So we have nothing to feed the machine. Nor can the buyers explain their own judgment. They can only say, 'Well, look at it. Can't you tell it's class such and such?'" Asimov wrote this in the 1940's and in this passage he tried to illustrate how unquantifiable and impenetrable human judgment was compared to artificially intelligent robots, which he saw as ultimately rational calculating machines. Ironically, today AI techniques such as neural networks are criticized for making much the same sort of impenetrable judgments.
- aidenn0 7y agoAsimov also assumed we wouldn't have AI at all if we couldn't mathematically prove certain things about it, and instead we are handing over deadly tasks to AI without any knowledge of how it works.
- galaxyLogic 7y agoYes Asimov assumes AI would be based on logic, he was not aware of neural networks which I think had not been discovered yet. It should have been clear though that if we grow brains in vats they might resemble human brains greatly.
- jsinai 7y agoI’m not sure that ML’s success in AlphaGo generalizes well. For example, Transformer architectures may be able to generate seemingly realistic text, but after a couple of paragraphs a human can pick out the incoherence. Furthermore ML still struggles with out of distribution (ood) samples which humans are able to navigate easily. > ... but computers are now on the same threshold as humans This parity is still extremely limited and far from general. Computers were developed in the first place to handle fast computation with ease. What we are seeing with ML is an extension of that computation by encoding complex information (such as images) extremely well. This is still in the same computation plane as calculators (performing operations on floats and integers), but forgive my pun, only deeper. Human cognition is much more than computation. What we have today with machine learning is still very much computation.
- taneq 7y ago> Human cognition is much more than computation. Are we sure? And don’t say “computers can’t appreciate a sunset” or any begged questions like that.
- TheOtherHobbes 7y agoWe're not sure, but it's a hypothesis that's still a long way from having solid evidential support. And there's no begged question about appreciated sunsets. The link between emotional and aesthetic perceptions is one of the key problem areas. Because aesthetic perception includes immediate sense data, but also links it with cultural contexts, personal memories, and sometimes a degree of artistic improvisation to communicate all of the related experiences, memories, and associations. It's precisely the difference between recognising a sunset with an image classifier and experiencing it with (say) another human that is far beyond current systems.
- jsinai 7y agoPrecisely. +1 to TheOtherHobbes There is so much to human cognition that researchers haven’t or have been unable to address in AI. We can tell from our memories that when we experience something, it is not simply raw perception. In fact our System 1 minds are filtering out most of our sensory input so that even if two people are watching the same sunset, they’ll notice it differently. And on top of that, our memories are infused with so many other details that are not sensory input but artefacts from our lived experiences, personalities and cultural heritage. So that now even if two people are noticing similar things, they’ll still experience the sunset differently. And next time you are looking at a sunset, try to gather of all your thoughts and explain precisely how you are experiencing it. That is hard. So yes even a simple begged question like that shows the differences between human and computer cognition enough.
- coldtea 7y ago>With AlphaGo in 2015 we crossed an important bridge in the Turing Test - before AlphaGo, we could be pretty certain that a high level Go game was played by a human. After AlphaGo, we can't be sure. So? That was true for Chess at one time, and Checkers or tic tac toe back in the 1900s. It's just a more computationally advanced version of a game with simple rules, not a general intelligence...
- drongoking 7y agoThe Turing Test has nothing to do with chess or any other game. It's a conversational test between two parties. It doesn't refer to human-level performance on any specific task. Please check Wikipedia. > Sure; all the parts haven't been completely connected to make self driving cars, general game playing AIs or conversation bots. This implies that connecting these systems is just a detail to be worked out. But the systems have nothing in common ontologically---they share no inputs, outputs, or intermediate concepts. The fact that they both use neurons doesn't mean much. You may as well say we can connect snails and dogs.