Interesting, especially fully attentional modules as alternative to conv layers (rather than in addition to). I hope they continue playing with it, especially w

Interesting, especially fully attentional modules as alternative to conv layers (rather than in addition to). I hope they continue playing with it, especially while evolving better architectures.