4 ms·
I'm reminded of the early days of "AI" when that consisted of building chess engines, because chess is what "intelligent" people do. They quickly realized that
by jfengel 4y ago
I'm reminded of the early days of "AI" when that consisted of building chess engines, because chess is what "intelligent" people do. They quickly realized that they were solving the wrong problem, doing the thing that humans are bad at and computers are good at.
In a sense language models appear to be doing the same thing again, one step down the scale. They're doing a human-specific thing, but missing whatever it is that non-human vertebrates do, and mammals do pretty well. I believe that this is the vast majority of human cognition, too. We just don't talk about it because when we talk about thinking, we're talking, and confuse the two.
These language models have done jaw-dropping things, and also make it abundantly clear that there's some fundamental thing that they've completely missed. It's plausible that that "thing" could emerge all by itself, using a mechanism entirely different from vertebrate cognition and yet somehow sufficient. Or it could be like the chess engines, doing something amazing and yet ultimately limited and of minimum utility.
- bawolff 4y ago> I'm reminded of the early days of "AI" when that consisted of building chess engines, because chess is what "intelligent" people do. They quickly realized that they were solving the wrong problem, doing the thing that humans are bad at and computers are good at. Is this really true? Because a lot of effort was spent on making computers as good at chess as human experts. It was considered a pretty big breakthrough when it happened and it definitely didn't happen early in the history of AI.
- PaulHoule 4y agoThere were chess playing engines circa 1980 on 8 bit micros (e.g. Sargon) that were a good match for ‘average’ players, Deep Blue beat Kasparov in 1997 with a large amount of custom hardware, Stockfish has been very strong on a powerful but ordinary PC since 2008 or so.
- zarzavat 4y agoYes people have been trying to make chess "AI" since the very beginning of the computer. A chess engine is an obvious thing to build with a computer because the rules of chess are uniquely suited to automation: there's enough possible moves per turn to make calculation difficult for humans, but not so many that it's difficult for computers too (as with Go). Early AI researchers did try to solve other problems, they just generally failed miserably.
- jfengel 4y agoBy the time they were trying to defeat the world champion, they didn't really think of it as an AI project any more. They often used the term "expert system", which had a much narrower scope. It had become a challenge unto itself, but they didn't expect it to lead to any kind of generalized intelligence. It came rather out of nowhere when neural-net-type engines suddenly swept back into dominance. Even after becoming the world chess champion, nobody expected Go to be solved any time soon.
- bawolff 4y ago> but they didn't expect it to lead to any kind of generalized intelligence. Do experts really expect any stream of AI research to lead to generalized intelligence (except in the very long term)? I was under the impression we really have no idea how to get there.
- JieJie 4y ago"Carmack sees a 60% chance of achieving initial success in AGI by 2030. Here’s how, and why, he’s working independently to make it happen." https://dallasinnovates.com/exclusive-qa-john-carmacks-different-path-to-artificial-general-intelligence/ https://dallasinnovates.com/exclusive-qa-john-carmacks-diffe...
- jfengel 4y agoRight now it's an open question. But they realized fairly soon that chess was a matter of minimax plus expert heuristics plus brute force. It was pretty clear that it was more effective than an expert system approach, which remained viable for another few decades.
- loa_in_ 4y agoHumans, collectively, almost have broken the barrier of qualia by now!