2 ms·
Interesting timing. Projects like Any-LLM or LiteLLM solve backend routing well but still involve server-side code. I’ve been tackling this from a different ang
by mkw5053 1y ago
Interesting timing. Projects like Any-LLM or LiteLLM solve backend routing well but still involve server-side code. I’ve been tackling this from a different angle with Airbolt [1], which completely abstracts backend setup. Curious how others see the trade-offs between routing-focused tools and fully hosted backends like this.
[1] https://github.com/Airbolt-AI/airbolt https://github.com/Airbolt-AI/airbolt
- swyx 1y ago(retracted after GP edited their comment)
- qntmfred 1y agodon't you post links to your own stuff all the time? i don't think their comment was out of line.
- mkw5053 1y agoI didn’t intend my original comment to be overly-promotional without relevance. I'm genuinely curious about the tradeoffs between different LLM API routing solutions, most acutely as a consumer.