3 ms·
The article starts out as if it's headed for "and that's how we did it". But no. There's no implementation. "Imagine a virtual team of AI agents, each with its
by Animats 2y ago
The article starts out as if it's headed for "and that's how we did it". But no. There's no implementation.
"Imagine a virtual team of AI agents, each with its workflow’s own specialism, collaborating to solve problems and make decisions just like a human team would."
OK. Where does that go?
So far, multi-agent systems have been delegating simple and well-bounded tasks, such as "fetch the weather info for Outer Nowhere" or "check airline schedules for flights from JFK to ORD", or even "what is 25% of $50". Those are questions inexpensive to answer, and don't need much management. If the subagents are complex, they will need management, and probably budgeting.
Subagents need to know when to stop and when to approximate. If the subagents are themselves generative AI systems, there's potential for hallucination at the lower levels generating info that the higher levels take as valid. Subagents also need to be able to query their managers - "is this enough detail" is a reasonable question to pass upwards. They may need to talk to their peer agents.
Now you have all the problems of organizational dynamics within a multi-agent AI system.
I look forward to reading papers with titles such as:
- "Teams of generative AI agents for coding - scrum or waterfall?"
- "Span of control - how many subagents should an agent manage?"
- "Does the agent org chart influence the solution too much?"
- "Resolving disagreements between specialized subagents".
That's where this is going. It has to. Once you start to cut a problem into pieces to be handled by different units, all those problems arise.
- fsndz 2y agothis is why I have been arguing there will be no AGI https://www.lycee.ai/blog/why-no-agi-openai https://www.lycee.ai/blog/why-no-agi-openai
- prox 2y agoIts a goal looking for a problem, aka AI hype. It’s the big thing now, like NFTs before. I agree with your blog, the definition itself is vague, and what people want to get out of it as well. There is a big “we’ll figure it out when we get there” attitude it seems to me. Imagine a society where everything can be and is done by AGI (and its drones) what then? What do we want out of it? What will define humans in such an environment?
- fsndz 2y agocan't agree more !
- ben_jones 2y agoPeople push back on the Crypto/NFT <—> LLMs comparison but I think it’s spot on. Crypto failed because it could never be honest about its trade offs and the reasons for centralization in the first place. It couldn’t be honest about its flaws because then VCs and private equity would make less money. LLMs as an immediate panacea is failing because it can’t be honest about what actual intelligence is, where human-computer-interaction is, and its ultimate goal of culling jobs. It couldn’t be honest about its flaws because then VCs and private equity would make less money. If only there was some pattern involved here we could avoid the pitfalls of these hype cycles - the pitfalls that end up in a whole lot of people being worse off and a couple new Lake Tahoe vacation home purchases.
- prox 2y agoI think you nail it. It is all about that honesty vs the hype.
- namaria 2y ago> Do LLMs present emergent capabilities You say no. I will have to disagree. Not in the fuzzy sense of "emergent = intelligent" people seem to be using. But in that LLMs are under the hood doing complex linear algebra, and when you pair numbers with words (or token word fragments), something like human language seems to emerge. LLMs have no concept of language, just matrices. The fact that we can map language to matrices with training, and then matrices to language with generative transformers, doesn't mean there's anything like intelligence going on. It's just pattern matching all the way down. But a surrogate of NLP emerges out of this.
- pessimizer 2y agoIt's wonderful to have new problems to solve. I'm looking forward to Robert's Rules of Order finally being considered a networking protocol between autonomous agents.
- exe34 2y agothose agents might end up with the same solution we came up with - endless meetings and then make the simplest piece of crap possible to meet half of the requirements.
- interstice 2y agoMaybe this is why multi agents are not the answer, or at least not in an individualist proto human sense. But does every agent have to be completely separate or could this kind of process land somewhere in sub-surface level processing within a single model? We are already there in some ways with node clusters handling specific subjects at the lowest levels - even being standard human is like being a large collection of processes all running in parallel.
- Animats 2y ago> But does every agent have to be completely separate or could this kind of process land somewhere in sub-surface level processing within a single model? Some agents won't be LLMs. Wolfram Alpha (now with ChatGPT) is close to this type of system.