2 ms·In the context of LLMs, the unit is token and to measure the output it's tokens per second (T/s)by Alifatisk 1y agoIn the context of LLMs, the unit is token and to measure the output it's tokens per second (T/s)