4 ms·
Dynamic code generation for calling APIs, not sure what is a fancy term for this approach.
by ekropotin 10mo ago
Dynamic code generation for calling APIs, not sure what is a fancy term for this approach.
- willahmad 10mo agothis assumes generated code is always correct and does exactly what's needed.
- ekropotin 10mo agoSame for MCP - there is always a chance an agent will mess up the tool use. This kind of LLM’s non-determinism is something you have to live with. And it’s the reason why I personally think the whole agents thing is way over-hyped - who need systems that only work 2 times out of 3, lol.
- anon84873628 10mo agoThe fraction is a lot higher than 2/3 and tool calls are how you give it useful determinism.
- ekropotin 10mo agoEven if each agent has 95% reliability, with just 5 agents in the loop the whole thing is just 77% reliable.
- anon84873628 10mo agoWell fortunately that's not what actually happens in practice.
- gzalo 10mo agoSomething like https://github.com/huggingface/smolagents https://github.com/huggingface/smolagents Needs a sandbox, otherwise blindly executing generated code is not acceptable
- inerte 10mo agoCloudflare published this article which I guess can be relevant https://blog.cloudflare.com/code-mode/ https://blog.cloudflare.com/code-mode/
- dwampler 10mo agoThis is a good example of how things are rapidly evolving. Also, the new foundation isn't called "The MCP Foundation", but the "Agentic AI Foundation". Clearly a buzzword-compliant name, but also hedging the bet that MCP will be the long-term central story.
- ianbutler 10mo agohttps://www.anthropic.com/engineering/advanced-tool-use#:~:text=and%20error%2Dprone.-,Our%20solution,are%20all%20explicit%20in%20code%20rather%20than%20implicit%20in%20Claude%27s%20reasoning.,-Example%3A%20Budget%20compliance https://www.anthropic.com/engineering/advanced-tool-use#:~:t... Anthropic themselves support this style of tool calling with code first party now too.
- ekropotin 10mo agoYup, that’s I’ve been taking about.