3 ms·
Unusably slow? It's like 0.3 seconds to first token and then pretty much all of the tokens can follow within a second. I find it hard to understand the edge us
by whimsicalism 3y ago
Unusably slow? It's like 0.3 seconds to first token and then pretty much all of the tokens can follow within a second.
I find it hard to understand the edge usecase for text-based models.
- deleted 3y ago[deleted]