3 ms·
This does work to a certain extent, but doesn't really converge for significantly more complex tasks. (Source: tried to make all sorts of agents work on complex
by omneity 3y ago
This does work to a certain extent, but doesn't really converge for significantly more complex tasks. (Source: tried to make all sorts of agents work on complex problems in a divide and conquer fashion)
They eventually ... lose the thread.
- mullingitover 3y agoDid you make a framework for the agents so they could delegate problems to an appropriate model, query a dataset, etc, or was it just turtles all the way down on GPT4? My hunch is that one big LLM isn't the answer, and we need specialization much like the brain has specialized regions for vision, language, spatial awareness, and so on.
- omneity 3y agoTo take the analogy of a company, the problem here is that management is really bad. What you described is rather akin to hiring better workers, but we need better managers. Whether it’s a single or multiple models is more of an implementation detail, as long as there’s at least one model capable of satisfactory goal planning _and_ following.
- omneity 3y agoLook at that! This might be the missing piece. https://ai.meta.com/research/cicero/ https://ai.meta.com/research/cicero/