3 ms·
> My money is on the fact that human intelligence guiding a search cuts another couple orders of magnitude off of how much of a long-shot discovering an intelli
by chriswarbo 10y ago
> My money is on the fact that human intelligence guiding a search cuts another couple orders of magnitude off of how much of a long-shot discovering an intelligent algorithm would be via a random search.
I certainly agree that directing/biasing evolutionary processes can be a reasonably efficient search strategy. The difficulty is that it still seems to be a fallback, suited to problems where we don't have a more informed strategy. For example, if we can calculate gradients, we're probably better off doing gradient descent. If we can perform deduction/induction on symbols, we're probably better off doing that. Those problems where evolutionary processes seem well suited are those where we might not know how to bias the search.
I think the best place for such approaches at the moment is meta-level algorithms, where "smarter" algorithms (like gradient descent) are applied to the underlying problems we care about, but the parameters, policies, etc. evolve on top (e.g. step sizes, which algorithms to use, when to restart, scheduling concurrent attempts, etc.).
That's the approach taken by NEAT for example, where a genetic algorithm comes up with neural network topologies, whilst those neural networks are trained using backpropagation.
- ewjordan 10y agoFWIW, I'm in no way suggesting that evolutionary strategies are the way forward in the search for AGI, though I suppose they might be part of the solution. My 95% bet is that a random or evolutionary search might be how people optimize an AGI, not how they find it. They'll get there via a minor but innovative twist on the RNN work we've already seen (first people need to realize that backdrop through time is a complete dead end, and they should be looking closer at reinforcement learning methods and figuring out how to bring them online).