4 ms·
"Our results demonstrate that even superhuman AI systems may harbor surprising failure modes." This is true but really is an empty conclusion. The result has no
by Upvoter33 2y ago
"Our results demonstrate that even superhuman AI systems may harbor surprising failure modes." This is true but really is an empty conclusion. The result has no meaning for future "superintelligences"; they may or may not have these kinds of "failure modes".
- Kapura 2y agoOn the contrary, this is the most important part of the thesis. They are arguing not only that this AI was vulnerable to this specific attack, but that any AI model is vulnerable to attack vectors that the original builders cannot predict or preemptively guard against. if you say "well, a superintelligence won't be vulnerable" you are putting your faith in magic.
- dragontamer 2y agoThey developed a system / algorithm that reliably defeats the most powerful Go AI, and is a simple enough system for a trained human to execute. Surely that's important? It was thought that AlphaGo and KataGo were undefeatable by humans.
- aithrowawaycomm 2y agoIt's more a lesson about the dangers of transferring an objectively true statement: "MuZero can beat any professional Go player" to a squishy but not false statement: "MuZero is an AI which is superhuman at Go" to a statement which is basically wrong: "MuZero has superhuman intelligence in the domain of Go."