4 ms·
How about just serving more clients in parallel? I don't see why human reading-speed should pose any kind of upper bound. And then there are use cases like Ope
by adwn 2y ago
How about just serving more clients in parallel? I don't see why human reading-speed should pose any kind of upper bound.
And then there are use cases like OpenAI's o1, where most tokens aren't even generated for the benefit of a human, but as input for itself.