3 ms·
People should stop associating neural networks with backpropagation networks. That is like saying all of AI is based on simplistic rule-based systems. I guess i
by ChaitanyaSai 18y ago
People should stop associating neural networks with backpropagation networks. That is like saying all of AI is based on simplistic rule-based systems. I guess it is mostly people with only casual knowledge of both fields who make suggestions of that sort.
Also, there is no reason to get outside the box. Most research and VC money tends to concentrate in one corner of the box. Go forth, be brave, and explore the box first!
- yters 18y agoI've been taking grad school courses in AI, and I'd say it's all rule based...stochasticity doesn't change that.
- ChaitanyaSai 18y agoBy "simplistic rule...", I implied something deterministic. If you define a rule as something that can include stochasticity, then how is a neural network something more than a stochastic graph with rules for communication?
- yters 18y agoIt isn't.
- Eliezer 18y agoI don't object to "backpropagation" aka gradient descent, which is a bit of simple calculus-based optimization. What I object to is the widespread public perception that saying "neural networks" is a brilliant new paradigm-overthrowing Key to General Intelligence, after over three damn decades. Biologically inspired stuff? I applaud it to the extent that it works. It's not a magic key to anything, and it doesn't avert the challenge of understanding.
- nazgulnarsil 18y agoit also seems the surest path to producing an intelligence that acts as if it were a product of natural selection, i.e. one that is selfish, xenophobic, etc. (other sexual competition based heuristics).
- deleted 18y ago[deleted]