3 ms·
Quick followup, what type of optimizer did you guys end up using?
by lightbyte 9y ago
Quick followup, what type of optimizer did you guys end up using?
- timanglade 9y agoSGD with Cyclical Learning Rates [0]. Honestly, it’s the closest to a Machine Learning silver bullet I’ve found to date! That paper is awesome. [0]: https://arxiv.org/abs/1506.01186 https://arxiv.org/abs/1506.01186
- lightbyte 9y agoThanks! I'm trying out your model on a small data set I've been playing with for identifying invasive species of flowers [0] and so far it's working way better than my initial version that was based on resnet (though slower)! [0] https://www.kaggle.com/c/invasive-species-monitoring https://www.kaggle.com/c/invasive-species-monitoring