I'm building a tool using system, and one of the problems I had is that it would hallucinate the tool answers before actually sending the question to the tool.

I'm building a tool using system, and one of the problems I had is that it would hallucinate the tool answers before actually sending the question to the tool. It really is just a system that completes documents, it doesn't care at all about the context that it is in beyond that text goes in and text goes out.