3 ms·

There's another paper replacing attention with FF networks so just combine the two and you've got something.

• gdoug 3y ago
  Link? Sounds like a good read! :)
  • smeeth 3y ago
    Not op but might be this: https://arxiv.org/pdf/2311.10642.pdf https://arxiv.org/pdf/2311.10642.pdf