3 ms·
For anyone curious about what the Gated Delta Network is: https://arxiv.org/pdf/2412.06464 https://arxiv.org/pdf/2412.06464
by mynti 1y ago
For anyone curious about what the Gated Delta Network is: https://arxiv.org/pdf/2412.06464 https://arxiv.org/pdf/2412.06464
- yorwba 1y agoAlso, Gated Attention: https://arxiv.org/abs/2505.06708 https://arxiv.org/abs/2505.06708