2 ms·
Show HN: BorgLLM, Zero-config LangChain Client, key rotation and rate limit mgmt
- omneity 1y agoHello HN! I've been developing a lot of LLM-based apps recently, and I got tired of writing the same glue code each time to switch providers, find the base URL again, or other strategies to deal with provider idiosyncracies, so I extracted out that code into an MIT licensed package named BorgLLM. It's a zero-config Langchain client to 100s of providers & models, it has automatic API key rotation, rate-limit fallback strategies and more concerns you won't have to put in your application code... One liner to rule them all (you can pick any model or any provider): llm = create_llm("anthropic:claude-sonnet-4") And my application code is finally clean, focusing on the domain. It's not a very complex package yet it might be one of the biggest time savers I added to my development workflow. I hope you'll find it useful. Questions and feedback points are most welcome!