4 ms·
thinking about this further, it seems difficult for CNNs to overcome the unified modeling benefits afforded by transformers. what do you think?
by panabee 4y ago
thinking about this further, it seems difficult for CNNs to overcome the unified modeling benefits afforded by transformers.
what do you think?
- godelski 3y agoI'll go a little against Sutton here, though I mostly agree with him. Sometimes restriction in architecture has benefits. Not all dimensions are equal.
- panabee 3y agodino v2 reflipped me, reasoning that text supervision artificially constrains image learning: https://arxiv.org/abs/2304.07193 https://arxiv.org/abs/2304.07193 if unified modeling isn't necessary, or even hurtful, a key advantage of transformers goes away.