3 ms·
Show HN: OpenAPI-batch: library for batch execution of LLM requests
`openapi-batch` is a small Python library for running batches of LLM requests reliably.
It provides:
- Async submission by default (you don’t block while the batch runs)
- Durable state in SQLite (track progress, resume inspection)
- Retries + partial failure handling
- Native batch support where providers offer it (OpenAI, Gemini)
- Provider adapters (no gateway required)
- Callbacks for progress, per-item completion, and job completion
License: MIT