5 ms·
The Safari of Deep Signal Processing: Hyena and Beyond
- T-A 3y agoImpressively applied here: https://hazyresearch.stanford.edu/blog/2023-06-29-hyena-dna https://hazyresearch.stanford.edu/blog/2023-06-29-hyena-dna
- alpark3 3y agoIs it reasonable to expect that some companies out there are training LLMs powered by Hyena instead of attention? Like a GPT-3 level size to bet on ultra-long context length?
- theGnuMe 3y agoYes.