AMeckes

4 ms·

1.
Show HN: Any-LLM chat demo – switch between ChatGPT, Claude, Ollama, in one chat(github.com)
10 points by AMeckes 1y ago|0 comments
2.
Show HN: mcpd – manage MCP servers with a single config file(github.com)
14 points by AMeckes 1y ago|1 comments
3.
by AMeckes 1y ago
We built mcpd to make MCP servers easier to work with. It's a daemon that runs MCP servers as subprocesses and exposes a unified HTTP API. Write your config once in .mcpd.toml and it works everywhere. Let us know what you think!
4.
by AMeckes 1y ago
Both approaches work well for standard text completion. Issues tend to be around edge cases like streaming behavior, timeout handling, or new features rolling out. You're absolutely right that any router reimplements interfaces for nor
5.
by AMeckes 1y ago
I didn't even need to click the link to know what this comic was. LiteLLM is great, we just needed something slightly different for our use case.
6.
by AMeckes 1y ago
Python only for now. Most providers have official TypeScript SDKs though, so the same approach (wrapping official SDKs) would work well in TS too.
7.
by AMeckes 1y ago
That's true. We traded API compatibility work for SDK compatibility work. Our bet is that providers are better at maintaining their own SDKs than we are at reimplementing their APIs. SDKs break less often and more predictably than APIs
8.
by AMeckes 1y ago
To clarify: any-llm is just a Python library you import, not a service to run. When I said "put it behind a proxy," I meant your app (which imports any-llm) can run behind a normal proxy setup. You're right that archgw handle
9.
by AMeckes 1y ago
Good points! any-llm handles the LLM routing, but you can still put it behind your own proxy for centralized control. We just don't force that architectural decision on you. Think of it as composable: use any-llm for provider switching
10.
Show HN: Any-LLM – Lightweight router to access any LLM Provider(github.com)
125 points by AMeckes 1y ago|68 comments
11.
Any Agent v0.21.0: Multi-turn conversations between AI agents via Google's A2A(github.com)
8 points by AMeckes 1y ago|0 comments
12.
Find, Retrieve, Answer: A simple RAG alternative for document QA with local LLMs(blog.mozilla.ai)
3 points by AMeckes 2y ago|0 comments