3 ms·Batch inference is not exclusive to OpenAI.by minimaxir 1y agoBatch inference is not exclusive to OpenAI.