3 ms·
The cost reduction is impressive, but I think consistency matters even more for production agents. I'd be interested to know whether prompt engineering or tool-
by redfather918 3mo ago
The cost reduction is impressive, but I think consistency matters even more for production agents. I'd be interested to know whether prompt engineering or tool-calling workflows had to change significantly.
- narmiouh 3mo agoHe actually talks about that in the article. Including how they had to rearchitect tool calling using nulls as well as limitations of prompt caching