3 ms·
> Why can't tweaking parameters be automated? Not only that it can be done, but it works even by random trial. Sophisticated optimization techniques work out j
by visarga 10y ago
> Why can't tweaking parameters be automated?
Not only that it can be done, but it works even by random trial. Sophisticated optimization techniques work out just 2x faster, so if you have cheap GPU, you can run 2x more trials and get your hyperparameters fine tuned.
If you want to apply optimization, you can use one of the popular libraries like hyperopt and MOE.
- kdelok 10y agoThis really depends on what the hyperparameter landscape looks like. In general, global optimisation is a very hard problem and doing it by random sampling might take longer than the lifetime of the universe (cf Levinthal's paradox for proteins).