3 ms·
I believe openai wants to lower the time it takes for requests to finish to be able to accept more requests per server/gpu. ie money.
by Racing0461 3y ago
I believe openai wants to lower the time it takes for requests to finish to be able to accept more requests per server/gpu. ie money.