4 ms·
I'm not clear on what advantage this architecture has over mamba/Griffin. They also have the linear scaling, better sequence parallelism and are competitive in
by trextrex 2y ago
I'm not clear on what advantage this architecture has over mamba/Griffin. They also have the linear scaling, better sequence parallelism and are competitive in performance with transformers.
- wave_1 2y agostate tracking...
- lalaland1125 2y agoThe whole field seems to be having issues with comparisons right now. We really don't even know how Mamba vs Griffin compare.