4 ms·
The debate over whether something is or is not AGI is entirely semantic and basically uninteresting. Let’s talk about what LLM agents demonstrably can or cann
by jaredklewis 1y ago
The debate over whether something is or is not AGI is entirely semantic and basically uninteresting.
Let’s talk about what LLM agents demonstrably can or cannot do. That’s an interesting discussion and we can design experiments to validate the claims. Comparing how LLMs perform versus humans in various tasks is also interesting and verifiable.
But trying to decide whether LLM agents have crossed over some amorphous, imaginary line with no quantitative definition is just a waste of time. It’s about equally productive as debating the question: “which is more human, an ant eater or a tree shrew?” Like why is there any value in that discussion?
- milesrout 1y ago[dead]
- tim333 1y agoMost people seem to have a definition of AGI something like being able to think as well as a human in all regards. The debates on current stuff doing that are dull because the answer is no, but the future may be interesting.
- jaredklewis 1y agoRight but “being able to think as a human in all regards” is a miserably vague definition that can’t be tested. To start, define think and specify which human. The best human? The average? Average or best by what metric? Without a quantitative definition, all views are basically valid and non-falsifiable.
- tim333 1y agoI'm not so sure. Like at the moment AI robots can't fix your plumbing hence the hypothesis we have AGI is falsified. I suspect when it comes, AI will blast through the "the best human? The average? Average or best by what metric?" thing fairly rapidly like it did with chess, go and the like.
- chpatrick 1y agoI think plumbing is an overly high bar. Your friend who lives on a different continent can't fix your plumbing either but they're still generally intelligent. It's only a fair comparison if we compare it to a human also communicating via some channel.
- jaredklewis 1y agoSo I’m fine with being able to fix some specified plumbing issue as being the AGI test, but it probably also means that humans don’t have AGI since it won’t be hard to find humans that can’t. But it doesn’t matter because that’s not the issue. The issue is that unless we all agree on that definition, then debates about AGI are just semantic equivocating. We all have our own idiolects of what AGI means for us, but like who cares? What everyone can agree on is that LLM agents cannot do plumbing now. This is observable and tells us interesting information about the capabilities of LLM agents.
- Jensson 1y ago> but it probably also means that humans don’t have AGI since it won’t be hard to find humans that can’t. Humans can learn to fix it. Learning is a part of intelligence. The biggest misconception is thinking that a humans intelligence is based on what they can do today and not what they can learn to do in 10 years. And since the AI model has already trained to completion when you use it, it should be able to do whatever any human can learn to do, or it should be able to learn. With this definition AGI is not that complicated at all.