4 ms·
Ooops, good catch — I had posted the wrong definition. Corrected now! It was convolution, batch norm, then elu activation.
by timanglade 9y ago
Ooops, good catch — I had posted the wrong definition. Corrected now! It was convolution, batch norm, then elu activation.
- lightbyte 9y agoQuick followup, what type of optimizer did you guys end up using?
- timanglade 9y agoSGD with Cyclical Learning Rates [0]. Honestly, it’s the closest to a Machine Learning silver bullet I’ve found to date! That paper is awesome. [0]: https://arxiv.org/abs/1506.01186 https://arxiv.org/abs/1506.01186
- lightbyte 9y agoThanks! I'm trying out your model on a small data set I've been playing with for identifying invasive species of flowers [0] and so far it's working way better than my initial version that was based on resnet (though slower)! [0] https://www.kaggle.com/c/invasive-species-monitoring https://www.kaggle.com/c/invasive-species-monitoring