3 ms·
M5's have the neural accelarator that boosts prefill speed a lot. But token generation itself will not change that much, that's true.
by freehorse 4mo ago
M5's have the neural accelarator that boosts prefill speed a lot. But token generation itself will not change that much, that's true.