2 ms·
I tried this recently and found the token overhead makes it prohibitive for any non-trivial schema. Dumping the full introspection result into the context windo
by storystarling 9mo ago
I tried this recently and found the token overhead makes it prohibitive for any non-trivial schema. Dumping the full introspection result into the context window gets expensive fast and seems to increase hallucination rates compared to just providing specific, narrow tool definitions.
- mmasu 9mo agoa friend (and colleague, disclaimer) pushed this recently to github. It passes data through a duck fb layer exactly to avoid context bloat: https://github.com/agoda-com/api-agent https://github.com/agoda-com/api-agent worth taking a look to see multiple approaches to the problem
- deleted 9mo ago[deleted]