4 ms·
I might be wrong, but strongly suspect that Fable 5 is already something in this shape, considering long time to first token while having normal troughput.
by Xx_crazy420_xX 3mo ago
I might be wrong, but strongly suspect that Fable 5 is already something in this shape, considering long time to first token while having normal troughput.
- Chu4eeno 3mo agoNo, that was because another Mythos 5 instance had to ACK the response before it was sent to the user.