3 ms·
Yeah the speed is vastly different but it's getting ~10 tps. And the MoE model is like 50 or something. Might use it if it proves to be much smarter I dont rea
by bakies 4mo ago
Yeah the speed is vastly different but it's getting ~10 tps. And the MoE model is like 50 or something.
Might use it if it proves to be much smarter I dont really monitor my agents while they're running.