5 ms·
Is running things in batch mode also cheaper? I don't see it, but it would be a nice way for OpenAI to smooth out their demand
by dosinga 2y ago
Is running things in batch mode also cheaper? I don't see it, but it would be a nice way for OpenAI to smooth out their demand
- davidbarker 2y agoAccording to their tweet, the discount on API costs will be 50%, so pretty significant. https://x.com/openaidevs/status/1779922566091522492 https://x.com/openaidevs/status/1779922566091522492