4 ms·
Reading this article I find myself thinking again how unhappy I am that a neural network won Go. I am unhappy because neural networks are not smart. They're the
by YeGoblynQueenne 11y ago
Reading this article I find myself thinking again how unhappy I am that
a neural network won Go. I am unhappy because neural networks are not smart. They're
the epitome of artificial stupidity: they learn, but they don't understand
anything that they learn. They can't take what they learned and apply it to another
domain, not without training again. And every time you train one in a new thing, it
forgets all about the old thing. They got intelligence alright, but it's the
dumbest kind of intelligence possible, mechanical, unaware of itself and devoid
of all purpose other than what we give it.
And what about ourselves? Building AlphaGo is a feat of human intelligence, but
how does it improve that human intelligence itself? How do we become smarter? We
can build machines to solve problems that we don't understand, but they solve
them in ways that we still don't understand. Except- we're not even trying
anymore. We've given up. Knowledge is hard. Logic is hard. Just throw a bunch of
GPUs at the problem and make it go away.
Far from this being a promising time for artificial intelligence, I fear we're
about to see a great dumbing down as funding is cut to everything but neural
networks research. A kind of AI summer, as it were.
- jamespitts 11y agoImagine that we augmented alphago by placing a system nearby that can introspect alphago and generate abstractions of what occurred, and then provide a human-understandable narrative about alphago's simulations during a game. What if the same narrative system could, either on its own or through human interaction, bring alphago back to previous states or new simulations? Might this combined system be closer to understanding, logically, what it has learned? Sometimes I wonder if inside of ourselves we come up with logical reasoning after intuition has pre-illuminated the path forward (based on experience). Or perhaps many different forms of thinking run in parallel, influencing each other. Each of us may have a very, very different combination of instinct, intuition, logic, etc.
- azag0 11y ago> neural networks are not smart That's like saying computers are not smart. It's meaningless. Computers are as smart as the algorithms they run and neural networks are as smart as the neural connections within them. Neural networks are models of computation as much as current computer architectures are. As far as we know, neural networks indeed are at the core of human intelligence. Human brain is an extremely complicated neural network with plenty of side mechanisms, many of which we possibly do not know about yet. Nonetheless it's unlikely that the underlying building blocks are not neural networks. What is probably several orders of magnitude more complex than uncovering the static architecture of the human brain, is understanding the way it is trained. Note that this is the case with artificial neural networks as well. I doubt that we will ever understand human intelligence "from above". It doesn't seem implausible to me that there is some general complexity theory law which prohibits intelligence "understanding" itself.
- dangirsh 11y ago> It doesn't seem implausible to me that there is some general complexity theory law which prohibits intelligence "understanding" itself. What about collective intelligence? What could prevent many intelligent agents from collectively reverse-engineering the algorithms they are individually running? Let say they then build a simulator and can use it to predict how any possible instantiation of their intelligence would behave. Can they (collectively) "understand" it any more than that? What question could you pose to test if they really understood it "from above"?
- YeGoblynQueenne 11y ago>> As far as we know, neural networks indeed are at the core of human intelligence. Right. Quick intro to neural models, for the only very slightly mathematically inclined. Neural networks solve this equation: Y = W ⋅ X Where X a matrix of inputs to a function ƒ, W a matrix of its coefficients and Y a matrix of its outputs. Once that's done once for all N instances of X in our dataset, a time period which we term an epoch, Y is used to calculate a measure of error, typically mean squared error: MSE = 1/N ∑ (Y' - Y)² Where Y' the true value of Y that we're trying to approximate. This is repeated until the cows come home, or until the network has converged, whichever comes home first (er, hint). And that's neural networks in a nutshell. There's nothing much more complicated than that (er, in theory), there's no magic and certainly nothing "like the brain" in them at all. They're just optimisation over systems of functions. We learned how to solve systems of functions with matrix multiplication when we were at high school. I'm pretty sure we did - I've personally repressed the memory but I'm pretty sure I did once have it. Why do people insist on calling them "neural"? Who the fuck knows. Way back in the 50s, the perceptron was based on a model of neural activation, where a neuron "fires" when its electrical charge crosses over a threshold. This was originally represented with a binary step function (the very one used in Perceptron classification). That was, at the time, deemed to be "a good model" of neural activation. A good model, my foot. Soon people moved on to sigmoid functions which are "a better model" of neural activation. Whatever. I've also heard it that, say, conv nets (convolutional neural networks) are "like the brain", presumably because if you squint at the layer connection diagrams long enough, conv nets start to look a bit like idealised models of the parts of the brain that handle vision. But if you squint long enough, everything starts to look like everything else. Hell, you might suggest that neural networks are based on the effin Tree of Life from Cabala, and Geoff Hinton is Alistair Crowley reincarnated. The whole "brain" thing is just an abstraction. You should not read too much into it. And don't listen to the people who try to convince you neural networks are magic- they're not. It's high school maths and a lot of very expensive processing power. P.S. If my notation doesn't make sense to you, you may need to use a different font in your browser; sorry about that.
- deleted 11y ago[deleted]
- jacquesm 11y ago> They're the epitome of artificial stupidity: they learn, but they don't understand anything that they learn. They can't take what they learned and apply it to another domain, not without training again. People are not smart by that same definition. We rarely - if ever - take something from one domain (say playing chess) and then find ourselves capable of applying it to another domain (say playing 'go') without significant adaptation. The little bit that gets recycled from one turn based game to the next hardly matters and I highly doubt there is someone out there that is a world champion or master class performer in more than one game using the same set of heuristics. That these limited AIs are unaware of themselves and mechanical is a different thing altogether.