2 ms·
The ~82B figure is an attempt to compare performance to an equivalent dense model. The amount of active parameters is given by the ~17B.
by zozbot234 7mo ago
The ~82B figure is an attempt to compare performance to an equivalent dense model. The amount of active parameters is given by the ~17B.