6 ms·
Take AlphaGo, because I know Go quite well. A computer is making better decisions than a human, using a pretty reasonable approximation of the same mechanism as
by roenxi 8y ago
Take AlphaGo, because I know Go quite well. A computer is making better decisions than a human, using a pretty reasonable approximation of the same mechanism as a human but scaled up. It needs relatively more resources (gameplay time, expert attention, etc) to a achieve a more focused result than a human expert.
At the moment, it is very easy to suspect that it is only the economics of training a neural net (hardware, specialist attention, data gathering an processing) that is holding us back from AGI.
Human brains can evolve by chance. Nothing fundamental is stopping us from creating a synthetic one. Natural Intelligence isn't that smart either, realistically.
- leg100 8y ago> Human brains can evolve by chance. What do you mean by this?
- rohanprabhu 8y agoNot OP, but I think they are referring to the basic premise of evolution. We still don't have a concrete theory on what causes mutation to occur, only one about which mutations end up surviving and sustaining across generations. As such the evolution of human intelligence is largely an enormous chain of favorable mutations having been coupled and survived over billions of years. And each mutation that did occur was owing to nothing more than chance.
- leg100 8y agoSince, as you say, we don't have a concrete theory on what causes mutations to occur, how can you then go onto say the reason they occur is nothing more than chance?
- vinn124 8y agofor a good introduction to order and complexity (including intelligence) arising from nothing, read "the origins of order" by stuart kauffman.
- tanilama 8y ago> At the moment, it is very easy to suspect that it is only the economics of training a neural net (hardware, specialist attention, data gathering an processing) that is holding us back from AGI. This is too early to call. NN acquires knowledge in a fundamentally different way than human. For example, to have a reasonable understanding of a certain language, like producing a sample of grammatically correct utterance, it definitely won't require a human to read the amount of text of Wikipedia, let alone multiple times.
- nobody271 8y agoYou're right but to be fair an individual human sits at the very top of billions of years of evolution. We don't have to have to read Wikipedia personally because most of the work was done by evolution, through our ancestors. We're really just hosts for our genetic code. It's the star of the show, not us.
- deleted 8y ago[deleted]
- xamuel 8y agoWe're getting really good at climbing trees. We've got guys who can climb even the tallest trees, no problem. Any day now, we're gonna finally climb to the moon.
- jf- 8y agoI love this comment. My hunch with regard to neural nets is that we’ve got something that looks like biology, and has a certain level of efficacy, but is missing a lot of the finer details that we’re unaware of in biology. Right now we’re just brute forcing problems with as much computing power and data as possible, biology obviously does better.
- Pica_soO 8y agoTrue, i think the real feasible way to grow a AI is- to actually repeat the process that grows us. As in- grow a single neuron creature in a challenging environment, and by acceleration, environment acceleration and evolutionary algorithm, herd the smarts toward sentience.
- currymj 8y agoit’s missing a lot of the finer details that we are aware of, too. a big one is timing — neurons in the real brain can delay firing depending on what signals they receive. there is research in training artificial neural networks with timing but it is not widely used for AI.
- state_less 8y agoThe tree climbers may well build a rocket and land on the moon anyhow. I think it’s a good idea not to add unwarranted mystery to the subject. We have good reason to believe our computers are underpowered for the task. This is a challenge, and while I think it’s going very fast, our collective sense of proportion of the timeline seems optimistic. In my view, if it happens this century, humans will have achieved an impressive feat. If we continue with geometric increases in flops/watt, maybe the rosy predictions will be closer than expected. I suppose what I’m implying is that nervous systems are doing computation, and not something mysterious that we don’t understand. The tree climbers knew they needed to climb higher and realized they’ll need another tool not a different understanding of spatial geometry.
- notahacker 8y agoIs it really "making better decisions than a human using a pretty reasonable approximation of the same mechanism as a human" though? To a layman, it looks rather more like an example of a high-powered calculator estimating Nash equilibria by crunching vast amounts of data. More human-like than Deep Blue, certainly, because it's not able to evaluate all possible game states so there's a bit of pattern recognition going on to cut down its search space, but it's succeeding in Go because with Go the higher level of abstractions humans work at is a coping mechanism for not having enough calculating power to simulate outcomes, not the only way of simulating possible outcomes. The issue that the real world is mostly not composed of optimisation problems with possible moves and win conditions as neatly and completely described in code and as replayable as Go is probably a thornier one for building AGI (as opposed to useful tools) through learning processes than the adequacy of the hardware...
- DanielGee 8y ago> Nothing fundamental is stopping us from creating a synthetic one. Ethical considerations are preventing us or at the very least limiting the speed of development. But mostly our lack of knowledge of the brain was what stopped us. Now that we are advancing on all fronts, I think we are going to be forced to deal with the ethics of neural/brain creation/destruction/experimentation. If scientists are able to keep disembodied brains "alive", then it will open up avenues for experimentation and ethical issues. https://news.ycombinator.com/item?id=16924764 https://news.ycombinator.com/item?id=16924764 There are even ethical issues of hybrid organ growth ( starting from the embryonic level ) where human organs are grown in pigs. The question is whether human cells can travel to pig's brains and cause pigs to be "more conscious". https://www.newsweek.com/it-ethical-grow-human-organs-pigs-465326 https://www.newsweek.com/it-ethical-grow-human-organs-pigs-4...
- YeGoblynQueenne 8y ago>> At the moment, it is very easy to suspect that it is only the economics of training a neural net (hardware, specialist attention, data gathering an processing) that is holding us back from AGI. Neural nets have fundamental limitations, particularly their inability to generalise outside a narrow band around their training set [1]. For instance- you will not find anything in the neural network bibliography about learning such a fundamental concept as counting, in the sense of finding the number n+1 that follows from a given number n, for arbitrary n. A neural net can certainly be trained on that task for numbers in a range [k,n] - but, given numbers outside this range its performance would "fall off a cliff". That's because neural networks can't learn general rules such as "x > y → y = x + k" etc. Add to this the fact that neural nets, while very good at specific tasks, must be trained anew for each new task- and you see that there is a big problem in getting anything approaching "general intelligence" (which might involve any number of wildly varying tasks) just with neural nets. For one thing- even if you could train a neural net model for something like a million tasks, there would remain the question of somehow stitching them all together in a coherent whole capable of performing the right task at the right time or combining decisions from multiple models. Finally, note that nobody is even trying to train a neural net to learn "general intelligence" end-to-end from examples; first of all, because we have no idea what constitutes general intelligence and therefore how to collect its examples. So it's not a matter of scale. More of a matter that there isn't anyone living today that has any idea how to get to AGI with any existing technique- including neural nets. ____________________ [1] https://blog.keras.io/the-limitations-of-deep-learning.html https://blog.keras.io/the-limitations-of-deep-learning.html
- YeGoblynQueenne 8y agoAs an aside, in order to be able to speculate about how close we are to AGI, with neural networks or any other technique, it is important to first unerstand the state of the art in AI. As usual, I'll recommend the classic AI textbook, "AI - A modern approach" by Russel and Norvig: http://aima.cs.berkeley.edu/ http://aima.cs.berkeley.edu/
- bachbach 8y agoAre you really under attack for recommending the standard textbook? This website's community has got peculiar more and more over the last 3-5 years and not in a positive way. There were the assholes of yesteryear but even they seemed like more sincere assholes than present day assholes.