3 ms·
It’s a small model. A 70B or larger model on a chip would be much more impressive and hopefully would have the same speed
by max8539 8mo ago
It’s a small model. A 70B or larger model on a chip would be much more impressive and hopefully would have the same speed