5 ms·
"Shotgun" just means "with restarts" (right?) but what do you mean by "ballistic"? "With momentum" maybe? I can't see that term used anywhere in the literature.
by jmmcd 12y ago
"Shotgun" just means "with restarts" (right?) but what do you mean by "ballistic"? "With momentum" maybe? I can't see that term used anywhere in the literature.
- ColinWright 12y agoSee my reply here: https://news.ycombinator.com/item?id=8917353 https://news.ycombinator.com/item?id=8917353 I probably should write this up properly sometime, along with the comment[0] dang[1] suggested I expand on. [0] https://news.ycombinator.com/item?id=8807580 https://news.ycombinator.com/item?id=8807580 [1] https://news.ycombinator.com/user?id=dang https://news.ycombinator.com/user?id=dang
- anonymousDan 12y agoHow does that differ from a "learning rate"?
- ColinWright 12y agoSorry - how does what differ from a "learning rate"? Learning rate as used in what connection? As far as I can see there is no connection between what I've described and anything I will call a learning rate in any of the other methods, so you'll have to be more explicit.
- anonymousDan 12y agoAh, I meant your notion of velocity/ballistic. I'm thinking of the learning rate parameter you might use to control how quickly a gradient descent algorithm converges for some machine learning algorithm.