3 ms·
Have you tried looking for what they mean by safe AGI? Ex: https://blog.openai.com/concrete-ai-safety-problems/ https://blog.openai.com/concrete-ai-safety-prob
by icebraining 9y ago
Have you tried looking for what they mean by safe AGI?
Ex: https://blog.openai.com/concrete-ai-safety-problems/ https://blog.openai.com/concrete-ai-safety-problems/
- logicallee 9y agoNo, I wasn't aware of that. This is a great link, thanks! To anyone else here is their excellent 2016 paper linked from the above: "Concrete Problems in AI Safety" https://arxiv.org/abs/1606.06565 https://arxiv.org/abs/1606.06565 and direct link to 29-page PDF: https://arxiv.org/pdf/1606.06565.pdf https://arxiv.org/pdf/1606.06565.pdf [PDF!] However, that PDF does not mention "AGI" even a single time, except in reference 17 "The AGI containment problem". That is actually also avaialable online here - https://arxiv.org/abs/1604.00545 https://arxiv.org/abs/1604.00545 but doesn't seem to be what they have in mind. So it seems the use of the term "safe" is actually much more narrow in AI literature and probably in the mind of the person who wrote that sentence, than I as a lay reader thought of reading it applied to AGI. It's an interesting idea.
- fossuser 9y agoOther terms that will help in your search are Friendly AI and the goal alignment problem. Check these out: https://intelligence.org/2016/12/28/ai-alignment-why-its-hard-and-where-to-start/ https://intelligence.org/2016/12/28/ai-alignment-why-its-har... https://wiki.lesswrong.com/wiki/Orthogonality_thesis https://wiki.lesswrong.com/wiki/Orthogonality_thesis