3 ms·
I see no mention of prior work Hyena Operator which already demonstrated O(n log n) full context mixing several years ago. https://arxiv.org/abs/2302.10866 htt
by semiinfinitely 2y ago
I see no mention of prior work Hyena Operator which already demonstrated O(n log n) full context mixing several years ago.
https://arxiv.org/abs/2302.10866 https://arxiv.org/abs/2302.10866
- intalentive 2y agoHyena came out of Albert Gu's prior work in the same lab. https://arxiv.org/abs/2111.00396 https://arxiv.org/abs/2111.00396