4 ms·
People have shown even CNNs can match up the peformance of the transformers. https://openreview.net/forum?id=TKIFuQHHECj# https://openreview.net/forum?id=TKIFu
by KuriousCat 3y ago
People have shown even CNNs can match up the peformance of the transformers.
https://openreview.net/forum?id=TKIFuQHHECj# https://openreview.net/forum?id=TKIFuQHHECj#
I believe there is a lot of herding going on due to the influence of people who had compute to play around with than deeply insightful or principled exploration of networks.
- jdeaton 3y agoyou linked a paper about vision transformers...
- deleted 3y ago[deleted]
- hervature 3y agoBeing used as a comparison... From the abstract: > Bringing these components together, we are able to build pure CNN architectures without any attention-like operations that are as robust as, or even more robust than, Transformers.