7 ms·
Group Normalization
- Y_Y 9y agoNo relation of subgroup normalisation, just a bad name.
- mrplank 9y agoHas anyone made or found an implementation yet?
- trott 9y agoFigure 3 in the paper.
- smhx 9y agoavailable in PyTorch master via: https://github.com/pytorch/pytorch/pull/5968 https://github.com/pytorch/pytorch/pull/5968
- argonaut 9y agoWhen it comes to using super new research models or methods in deep learning, implementing it yourself instead of looking for other implementations is almost a requirement. In my experience the majority of online "implementations" of research deep learning models or methods have subtle bugs, flaws, or outright implemented something different than the paper they reference. This isn't limited to random github code: for example, I wouldn't trust anything in tensorflow.contrib unless I read the source.
- Cacti 9y agoCompletely agree. Well, tf.contrib I am usually happy with the docs and a glance through GitHub issues, but, yes, code found elsewhere for very new, or even just recent papers can be really hit or miss, and not always obviously so. There is a lot of great stuff out there, but sometimes even popular papers over a year old can still be a challenge to find good code for. finding 3 separate implementations, all stlighty wrong or unusable is not uncommon.
- legulere 9y agoHaving implemented algorithms from research papers I came to the conclusion that the same is true about the papers. It’s unbelievable how bad the quality of the description of algorithms often is.
- logicallee 9y agoAre you generally able to achieve the results the new research claims after you implement it yourself per their description? I would have thought if their description is shit then their results are shit too (cherry-picked from hundreds of runs, outright fabricated, misinterpreted, incorrectly graphed, whatever - just plain doesn't work, like a bad recipe.) As a followup if this is the case then how do you know what new deep learning research is worth your time to implement?
- p1esk 9y agohttps://github.com/ppwwyyxx/tensorpack/blob/master/examples/ImageNetModels/vgg16.py https://github.com/ppwwyyxx/tensorpack/blob/master/examples/...
- toxik 9y agoMostly only relevant for convnets it seems
- black_puppydog 9y ago"only"
- godelmachine 9y agoNothing to do with database normalization or reconciliation