4 ms·
https://arxiv.org/abs/2008.02217 https://arxiv.org/abs/2008.02217 They derive Q, K, V as a continuous analog of a hopfield network
by vatsachak 10mo ago
https://arxiv.org/abs/2008.02217 https://arxiv.org/abs/2008.02217
They derive Q, K, V as a continuous analog of a hopfield network