6 ms·
FNet: Attention may be all you WANT but we you need is good token mixing
- thebladerunner 5y agoThis paper has been making rounds in the last few days on Reddit ML and Twitter.
- thebladerunner 5y agohttps://www.reddit.com/r/MachineLearning/comments/ncdy6m/r_google_replaces_bert_selfattention_with_fourier/ https://www.reddit.com/r/MachineLearning/comments/ncdy6m/r_g...