2 ms·
There's a Halting Problem analogy going on here. (Or Rice's Theorem analogy, if you prefer.) Once you build an AI program of a certain baseline sophistication,
by dreamcompiler 4y ago
There's a Halting Problem analogy going on here. (Or Rice's Theorem analogy, if you prefer.)
Once you build an AI program of a certain baseline sophistication, you won't be able to prevent it from leaking information you don't want it to leak unless it further achieves at least the meta-level sophistication of the smartest human asking it questions.
- Tainnor 4y agoI was exactly thinking of Rice's Theorem too. I don't know if OpenAI is equivalent in power to a Turing machine (or whether we can even formalize it in that way since it's non-deterministic), but if it is, it's effectively impossible to prevent it from exhibiting certain properties.