3 ms·
'Superhuman' has many dimensions. It can be speed, it can be ability to retain a lot of information, it can be the ability to deal with a large quantity of info
by jacquesm 4y ago
'Superhuman' has many dimensions. It can be speed, it can be ability to retain a lot of information, it can be the ability to deal with a large quantity of information at once and many other dimensions besides. For the longest time Chess was considered a domain where computers could be dilettantes but could never dominate. Chess is now in 'superhuman' territory and likely we will never see a reversal because any insight that benefits humans also benefits computers but not the other way around.
The fact that this is such a multi-dimensional problem is frequently overlooked in the debate about AI/AGI etc, it may not matter all that much if the non AGI AI is already superhuman on enough dimensions other than the ones that the 'but it isn't AGI' crowd cling to. The consequences are what matters, not the fine print or the implementation details, and those consequences are directly tied to the number of dimensions along which a computer can beat humanity.
To give an example: if a chess program was 3000 Elo before but so slow that it would lose under competition rules then humans still dominated chess. Likewise if it would be only 2500 Elo but fast enough, it would still lose from the best humans. But for a large fraction of society it would have already moved out into 'superhuman' territory. And a couple of technological leaps of progress later and we're all looking at that AI as if it has moved into superhuman regions.
This sort of thing will happen on many fronts, and all of those fronts are moving, if enough of them go past the threshold then whether it is AGI or not is irrelevant and for every person that threshold is at different points. Maybe a computer will be able to calculate faster and better than you can, maybe it will be able to translate text faster and better than you, maybe it will be able to organize information faster and better than you. At which point we cross the line into saying that it can think faster and better than you is hard, but we can see that we are getting close to that line without even knowing exactly where that line is.
- pmoriarty 4y ago"Chess is now in 'superhuman' territory and likely we will never see a reversal because any insight that benefits humans also benefits computers but not the other way around." What is considered human is malleable. It is conceivable that humans will be enhanced in various biological and non-biological ways to a point that they can once again compete with computers.
- Mezzie 4y agoWe may also just change the rules of chess. "Chess" is a human created game after all.
- dmd 4y agoLook I found the guy who keeps moving the goalposts!
- Mezzie 4y agoIt's a pretty common way for humans to deal with not being able to do something/something not working.
- anthomtb 4y agoI think you're making a joke. But moving goalposts is an integral part of all professional sports. The 3 point line in basketball and engine size and aspiration in motorsports are obvious examples. I don't see how adjusting chess rules to dis-favor AI competitors is any different.
- evrimoztamur 4y agoSomebody actually tried with https://en.m.wikipedia.org/wiki/Arimaa https://en.m.wikipedia.org/wiki/Arimaa, but it didn't last too long until it was also figured out!
- drakenot 4y agoI'm curious what kind of rule changes that could be made that would make Chess harder for deep neural networks?
- ChatGTP 4y agoI'm curious, what is the point your trying to convey?
- jstanley 4y ago> if a chess program was 3000 Elo before but so slow that it would lose under competition rules then humans still dominated chess. How are you working out that it has a 3000 Elo if it's not winning games?
- jacquesm 4y agoThat's the way it is done right now: by playing it against other software implementations and judging them in the exact same way they would judge humans. Stockfish has an Elo rating over 3500 in spite of no human being even close to that.
- m3kw9 4y agoIs like a CPU, we’ve all seen that movie before, it’s super human in calculating numbers, it’s one dimensional nonetheless like chess programs.
- skybrian 4y agoOne dimension that I think is pretty important is compute cost due to its effect on how they’re used. The chatbots are expensive to run, which means they’re implemented as request-response API’s that cost money, which means that loops are expensive and they normally don’t do any idle-time thinking. When you play a turn-based game with a bot, that means you don’t need to worry about its reaction time. It’s paused most of the time, waiting on you. A sorcerer’s apprentice scenario isn’t going to happen when you’re single-stepping. Moving to routine use of bots that run continuously with fast reaction times will be much more dangerous.
- jacquesm 4y agoYes, that's a very good point. Effectively it is 'ping pong' right now, when you get to always on + push things will change quite a bit. Model efficiency is a very active field.
- andrepd 4y ago> For the longest time Chess was considered a domain where computers could be dilettantes but could never dominate I don't think this was ever true. Chess programs appeared EXTREMELY early in, and everyone recognised that it was a matter of time until hardware was quick enough to evaluate so many positions per second that grandmasters could be defeated by sheer calculation.
- jacquesm 4y agoI was playing chess pretty fanatically when Sargon came out and that was my impression as a computer person, but the chess people around me really didn't think that computers would ever beat the top GMs.
- macintux 4y agoMost major advances are predicted by someone, and often seem obvious in hindsight, but it seems like we often conflate those and remember them having been obvious before they happened.
- jacquesm 4y agoThe number of people working with computers back then was but a handful so that gave me a bit of a different perspective but I think that anybody that was both into computers and into chess back then would have made the same prediction. It still happened faster than I thought it would.