4 ms·
MoE eats the same amount of RAM but accesses less of it.
by yencabulator 1y ago
MoE eats the same amount of RAM but accesses less of it.
- sliken 1y agoMore accurately, same amount of ram but accessed in a cache friendly manner with greater locality.