2 ms·
OpenAI offers that, or at least used to. You can batch all your inference and get much lower prices.
by stavros 9mo ago
OpenAI offers that, or at least used to. You can batch all your inference and get much lower prices.
- airspresso 9mo agoStill do. Great for workloads where it's okay to bundle a bunch of requests and wait some hours (up to 24h, usually done faster) for all of them to complete.