4 ms·
The problem is the exponential explosion of possibilities. Fairly amateur Python code can work through a problem in 10 minutes which, without gradient descent,
by lkrubner 8y ago
The problem is the exponential explosion of possibilities. Fairly amateur Python code can work through a problem in 10 minutes which, without gradient descent, would literally take a thousand years.
- YeGoblynQueenne 8y agoThe term is "combinatorial explosion". Like the ability to train larger, deeper, heavier neural nets, that too gets better with more computing power.
- bra-ket 8y agoour brain is not doing brute force search
- eli_gottlieb 8y agoRight, it's doing stochastic search through a Bayesian posterior distribution. The trouble is that established inference techniques can't really handle very general, "human-level" model classes in real time, computationally.
- throwaway2048 8y agoWe have no idea if that is true or not.