4 ms·

In my opinion, this looks promising: https://github.com/stevenwalton/SCS-CCT https://github.com/stevenwalton/SCS-CCT 4% improvement over Compact Transformers,

In my opinion, this looks promising: https://github.com/stevenwalton/SCS-CCT https://github.com/stevenwalton/SCS-CCT 4% improvement over Compact Transformers, which is considered SOTA EDIT: As meragrin_ pointed out, I read the graph the wrong way. It's actually 4% worse. Sorry.

meragrin_ 4y ago
Where do you see improvement? According to the graph and text, there is a 4% decrease in performance. It is slightly worse.