4 ms·
Would it be possible to make the hyperparameters optimizable? Maybe it's the biologist in me, but I can't really see a reason why you couldn't just let the algo
by AllegedAlec 9y ago
Would it be possible to make the hyperparameters optimizable? Maybe it's the biologist in me, but I can't really see a reason why you couldn't just let the algorithm decide for itself which values of those parameters would work best.
- archgoon 9y agoI don't understand; the entire article is entirely about methods of doing that.
- AllegedAlec 9y agoMaybe I wasn't clear, or misunderstood some of the article, but I thought the article was about optimising the hyperparameters before the machine learning part happens. I meant optimising the parameters during the machine learning iterations.
- pklehre 9y agoThis reminds me of self-adaptive evolutionary algorithms.