4 ms·
Pretty much, MCP is still a bad idea. LLMs perform significantly better and faster when you strap them to plain old apis/and an open api spec with a search too
by what-the-grump 15d ago
Pretty much, MCP is still a bad idea.
LLMs perform significantly better and faster when you strap them to plain old apis/and an open api spec with a search tool.
My current MCP design is… grab a fastapi spec shove it into fastmcp, shallow wrapper, search tool for the full schema.
Oh boy so exciting I just wrapped an api spec for no reason and have to host infra for the translation layer. If only we invented api gateways.
But I am Mr. AI now.
- isbvhodnvemrwvn 15d agoHow do you handle credentials safely?
- SgtBastard 15d agoJust leak them to the inference providers, obviously /s If you have self hosted models and/or self hosted APIs, maybe you don’t need MCP to provide a gateway to a secure resource. If neither of those things are true, you need an authenticating gateway/proxy or a target API that supports single use credentials (and get the model to generate a call to use them). We can argue whether MCP is a good authenticating middle layer, but not whether one is required.
- jimbokun 14d agoWhat about just handing the agent a token with limited time to live and constrained access permissions?