4 ms·Mixture-of-Depths Attention4 points by neehao 6mo agoneehao 6mo agosee also: https://lh-zhu.github.io/The-Second-Half-of-Model-Architecture/ https://lh-zhu.github.io/The-Second-Half-of-Model-Architectu...