4 ms·
A lot of the referenced analysis makes sense, but this article comes across as pessimistic far beyond what any of the commenters they're quoting said or would e
by SpicyLemonZest 6y ago
A lot of the referenced analysis makes sense, but this article comes across as pessimistic far beyond what any of the commenters they're quoting said or would endorse. Identifying the political leader with the most power over the American colonies demonstrates significant conceptual understanding, even if that's not quite what "president of the United States" means. And innumeracy isn't "odd for a computer system" - there's no fundamental property of numeracy we'd expect to reach out from the motherboard and make a text-based AI good at math.
- wombatmobile 6y agoCould we be optimistic for a moment? There's plenty of time left for progress. Imagine if all of the issues raised in the article were addressed and implemented in GPT-4. Imagine more iterations, all the way up to GPT-42, sometime in your great grandchildren's lifetime. Q: What is the difference between what GPT-42 might do, and what you might do to answer this question?
- SpicyLemonZest 6y agoYou'd have to study the GPT architecture to answer that question. For example, there's a comment upthread describing how its arithmetic capacity may be artificially low due to the way it parses math problems. I've seen another analysis, I forget where, explaining that it's fundamentally incapable of certain kinds of complex reasoning because the sequence of transformations producing the output is static and non-rewindable. While the article's extreme skepticism is unwarranted, most experts do seem to agree that GPT can't scale to general human-level intelligence.
- wombatmobile 6y agoThank you for a considered response, SpicyLemonZest. When I posted that question I half expected to be howled down as a troll, a naysayer, or off-topic. I'm glad you did none of that and answered by sharing your thoughts. As humans in the community of HN, we are richer for it. > most experts do seem to agree that GPT can't scale to general human-level intelligence. What is it about human-level intelligence that's unreachable by machines, even machines as advanced as V42 of GPT, would you consider? Can you put your finger on it, or make a little start?
- SpicyLemonZest 6y agoI doubt there's any property of human-level intelligence that's inherently unreachable by machines. The question is whether GPT-42 would actually be tremendously advanced, or whether we're close to the limit of what the architecture can produce. The consensus among experts I've read is that known architectural limitations make the GPT-n series unlikely to scale beyond "sounds very human if you don't question it too closely". Algebra, to pick a concrete example, is something that there's reason to believe the GPT-series can't learn effectively - the output generation mechanism is fundamentally incapable of looping or recursion, which severely limits how well it can break things down into subproblems.
- Scaevolus 6y agoA fair amount of the innumeracy is due to Byte Pair Encoding tokenizer garbling numbers to the point that the network can barely see a consistent represention of them-- it's like talking about how innumerate Romans are at adding their numerals. I don't have the tokenizer handy right now, but a query like "1003 + 580 =" might be tokenized as 100, 3, space, plus, space, 5, 80, space, equals. Not very easy to learn!