3 ms·
Will your arch work for SSMs?
by cma 3y ago
Will your arch work for SSMs?
- trsohmers 3y agoYes; Mamba was a very easy match, with Hyena also being a good match, but could be greatly optimized with some minimal changes to the model architecture or hardware design.