2 ms·
That's kinda horrifying... Accruing useless code to reduce the probability of mutating the useful code? Sounds like a better regularization strategy is needed.
by sdenton4 9y ago
That's kinda horrifying... Accruing useless code to reduce the probability of mutating the useful code? Sounds like a better regularization strategy is needed.
I'm generally pretty suspicious of generic algorithms; why take a random walk when you can March along the gradient towards a solution?
It might be interesting to try using GA for neural architecture, though, and gradient descent to train the network... (Though it sounds expensive.)
- raverbashing 9y ago> why take a random walk when you can March along the gradient towards a solution? Because your problem has no smooth/continuous gradient Because your problem has a giant search space Because your problem can do with a "close enough" solution Try gradient descending a symbolic regression and we'll talk