2 ms·
That is my speculation. But the question is one of intuition. If the speculation is correct, that some problems are better solved by a single more intelligent a
by zoogeny 3y ago
That is my speculation. But the question is one of intuition. If the speculation is correct, that some problems are better solved by a single more intelligent agent, then how can I determine the appropriate approach?
What I mean to say is, if I am considering building a product based on LLMs then I may have to make a basic decision: can I use multiple cheap LLMs in a multi-agent setup or must I use a single expensive powerful LLM. Right now I don't have any intuition on what kinds of problems are solved most efficiently by either approach. Just looking at a problem description I can't intuit which approach is appropriate.
- kian 3y agoThis is a very interesting and important question. I think that until we answer your question rigorously, the best bet right now is to start with the expensive powerful LLM, and then after your system is prototyped and working, piecewise move prompts in your prompt network over to other systems as it proves feasible. If you try to start with the multiple cheap LLMs approach, it is almost certainly going to be more difficult to get the prompting right, and if you don't already know what you are trying to accomplish is feasible, you're adding a lot of work that might add up to nothing (even if it would actually work if you used the more powerful model).