3 ms·
> Furthermore, Resnet-50 is back to sota because of up-to-date training protocols, and every paper that claimed superiority was using outdated training techniqu
by joconde 5y ago
> Furthermore, Resnet-50 is back to sota because of up-to-date training protocols, and every paper that claimed superiority was using outdated training techniques (or even none at all) for the baseline.
That's interesting, do you have a source? I've been thinking about switching to some fancy new architecture in prod, but wasn't sure it would be worth it.
- PartiallyTyped 5y agoCurrent SOTA afaik are: - Patches is all you need [1] - ResNet-50 with new protocols [2] - MLP Mixers [3] [1] https://old.reddit.com/r/MachineLearning/comments/q35lex/r_patches_are_all_you_need/ https://old.reddit.com/r/MachineLearning/comments/q35lex/r_p... [2] https://old.reddit.com/r/MachineLearning/comments/q0vt2b/r_resnet_strikes_back_an_improved_training/ https://old.reddit.com/r/MachineLearning/comments/q0vt2b/r_r... [3] https://old.reddit.com/r/MachineLearning/comments/n59kjo/r_mlpmixer_an_allmlp_architecture_for_vision/ https://old.reddit.com/r/MachineLearning/comments/n59kjo/r_m...
- ShamelessC 5y agoI think it's somewhat confusing to compare an MLP Mixer architecture to a vanilla ResNet-50.
- PartiallyTyped 5y agoWhat do you mean confusing? ResNet-50 with updated training protocol seems to be doing pretty well!