4 ms·

It's a "well defined" term in the crackpot side of AI, represented by lesswrong et al, who are self appointed AI experts who have never published any actual pe

It's a "well defined" term in the crackpot side of AI, represented by lesswrong et al, who are self appointed AI experts who have never published any actual peer reviewed research in AI.

Max_Limelihood 4y ago
Self-appointed by the boards of directors at major companies and universities? https://slatestarcodex.com/2015/05/22/ai-researchers-on-ai-risk/ https://slatestarcodex.com/2015/05/22/ai-researchers-on-ai-r... And no peer-reviewed research, apart from the dozens of widely-cited academic papers on this? All of these are just from one lab, not even including groups like CHAI: https://www.anthropic.com/#papers https://www.anthropic.com/#papers
- random314 4y ago
  > And no peer-reviewed research, apart from the dozens of widely-cited academic papers on this? All of these are just from one lab, not even including groups like CHAI: https://www.anthropic.com/#papers https://www.anthropic.com/#papers Which of these papers track AGI Safety and are also published in peer reviewed journals like SIGKDD, NeurIPS, AAAI etc?
mchaver 4y ago
OpenAI mentions AI Alignment and they are currently at the forefront of pushing AI on the world so it is not just that community, though I wouldn't be surprised if many employees at OpenAI participate there. https://openai.com/blog/our-approach-to-alignment-research https://openai.com/blog/our-approach-to-alignment-research
- random314 4y ago
  Open AI is one of the actual research organizations promoting AI Safety work. However, this has more to do with funding and the money put up front by the original founders - Elon Musk, Sam Altman etc, who themselves are not AI researchers, yet AGI enthusiasts. Open AI published a number of papers, essentially and implicitly supporting the position of the AI inexperienced founders. They try to highlight AI safety aspects quite frequently. But I would not take it too seriously, just like you wouldn't take a Facebook employees endorsement of Zucks vision. If you are familiar with ML, you would know that L2 norms are a key optimization metric in ML. L2 norms are basically Pythagorean hypotenuse computations in high dimensions. I will take AI safety research seriously when they start discussing the risk factors associated with Pythagoras theorem and how we as a society must deal with it before we become a slave to L2 norm driven super intelligence. If you want to really talk about human risk from AI, Tesla's self driving killing machines are already here along with ML guided drone bombers. It's no different from Therac 25. If we are not discussing these and creating a course about super intelligence, it's just mental masturbation.
  - mchaver 4y ago
    Thanks for the response. My hope for AI Alignment studies is that it would be something rigorous and theoretical and be testable in current AI safety issues. Much like studies of abstract algorithms can be compared and contrast with the runtime of actual algorithms. What I have seen in LessWrong is lots extrapolations upon extrapolations with worse case scenarios just to say there is nothing we can do. That seems to take away from any serious research that might exist since they are probably the best known community associated with AI Alignment.

It's a "well defined" term in the crackpot side of AI, represented by lesswrong et al, who are self appointed AI experts who have never published any actual peer reviewed research in AI.

Max_Limelihood 4y ago

Self-appointed by the boards of directors at major companies and universities? https://slatestarcodex.com/2015/05/22/ai-researchers-on-ai-risk/ https://slatestarcodex.com/2015/05/22/ai-researchers-on-ai-r... And no peer-reviewed research, apart from the dozens of widely-cited academic papers on this? All of these are just from one lab, not even including groups like CHAI: https://www.anthropic.com/#papers https://www.anthropic.com/#papers

random314 4y ago
> And no peer-reviewed research, apart from the dozens of widely-cited academic papers on this? All of these are just from one lab, not even including groups like CHAI: https://www.anthropic.com/#papers https://www.anthropic.com/#papers Which of these papers track AGI Safety and are also published in peer reviewed journals like SIGKDD, NeurIPS, AAAI etc?

mchaver 4y ago

OpenAI mentions AI Alignment and they are currently at the forefront of pushing AI on the world so it is not just that community, though I wouldn't be surprised if many employees at OpenAI participate there. https://openai.com/blog/our-approach-to-alignment-research https://openai.com/blog/our-approach-to-alignment-research

random314 4y ago
Open AI is one of the actual research organizations promoting AI Safety work. However, this has more to do with funding and the money put up front by the original founders - Elon Musk, Sam Altman etc, who themselves are not AI researchers, yet AGI enthusiasts. Open AI published a number of papers, essentially and implicitly supporting the position of the AI inexperienced founders. They try to highlight AI safety aspects quite frequently. But I would not take it too seriously, just like you wouldn't take a Facebook employees endorsement of Zucks vision. If you are familiar with ML, you would know that L2 norms are a key optimization metric in ML. L2 norms are basically Pythagorean hypotenuse computations in high dimensions. I will take AI safety research seriously when they start discussing the risk factors associated with Pythagoras theorem and how we as a society must deal with it before we become a slave to L2 norm driven super intelligence. If you want to really talk about human risk from AI, Tesla's self driving killing machines are already here along with ML guided drone bombers. It's no different from Therac 25. If we are not discussing these and creating a course about super intelligence, it's just mental masturbation.
- mchaver 4y ago
  Thanks for the response. My hope for AI Alignment studies is that it would be something rigorous and theoretical and be testable in current AI safety issues. Much like studies of abstract algorithms can be compared and contrast with the runtime of actual algorithms. What I have seen in LessWrong is lots extrapolations upon extrapolations with worse case scenarios just to say there is nothing we can do. That seems to take away from any serious research that might exist since they are probably the best known community associated with AI Alignment.