4 ms·
How do you select the average size/standard deviation of your perturbations? Too small and you get no benefit, or very little speed up, too large and you lose t
by AndrewOMartin 9y ago
How do you select the average size/standard deviation of your perturbations? Too small and you get no benefit, or very little speed up, too large and you lose the ability to sensibly optimise, and if you attempt to make an adaptive function then you'll find yourself with another postdoc.
- LolWolf 9y agoYou could probably let the schedule of the perturbations be a sequence ε→0, such that ∑ε = ∞, and such that ∑ηε < ∞ with probability 1, where η is IID, bernoulli on {-1, 1} (e.g. a square-summable sequence will do). I suspect this will be a fairly good start. Note that, then it should in general be independent of the chosen parameter, since the added noise converges in probability to a constant whenever the distribution is close to uniform, but can sum to any real value with consistent bias.
- deepnotderp 9y agoIt's a scheduled hyperparameter like the learning rate. All my scalar/non-architectural hyperparameters are optimized using DQNs.