4 ms·

A significant number of people in positions of power in the AI industry get their moral framework from science fiction books and a particular Harry Potter fanfi

by m-ee 2mo ago

A significant number of people in positions of power in the AI industry get their moral framework from science fiction books and a particular Harry Potter fanfiction. It’s hard to predict what ideas and philosophies will become important.

Hugsbox 2mo ago
Sorry, purely just curious here because I'm not sure what you mean - what Harry Potter fanfiction?
- krapp 2mo ago
  "Harry Potter and the Methods of Rationality" written by Eliezer Yudkowsky has become something akin to a sacred text among the rationalist community. edit: posted is a podcast by Behind the Bastards about the Zizians, a death cult that branched out of rationalist community and which was responsible for six deaths, but it covers the rationalist community and the Harry Potter fanfiction as well. [0]https://www.youtube.com/watch?v=9mJAerUL-7w https://www.youtube.com/watch?v=9mJAerUL-7w
  - Hugsbox 2mo ago
    Sweet, I love Behind the Bastards, thanks for providing the entertainment for my next few walks :)
arjie 2mo ago
Most people get their moral framework from TV, movies, and memes. Hence the common refrain of “this is just like gattaca” and “have you not seen the movie X? This happens there!” And the torment nexus crap. I call this https://wiki.roshangeorge.dev/w/Story-Logic_Bias https://wiki.roshangeorge.dev/w/Story-Logic_Bias But that seems normal and historical. Stories are how we encode memorable concepts for transmission to each other and probably why the Bible is full of parables and so on. Someone pointed out to me that said Harry Potter fanfiction author has written about this specific bias as well https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logical-fallacy-of-generalization-from-fictional https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logica...
s1artibartfast 2mo ago
That seems like a major misstatement. The likes of Yudkowsky and his types are the primary critic and proponent of regulating the AI industry. How do you reconcile the values of those proposing moratorium up to and including bombing data centers with those who are building them as being the same?

by m-ee 2mo ago

Hugsbox 2mo ago

Sorry, purely just curious here because I'm not sure what you mean - what Harry Potter fanfiction?

krapp 2mo ago
"Harry Potter and the Methods of Rationality" written by Eliezer Yudkowsky has become something akin to a sacred text among the rationalist community. edit: posted is a podcast by Behind the Bastards about the Zizians, a death cult that branched out of rationalist community and which was responsible for six deaths, but it covers the rationalist community and the Harry Potter fanfiction as well. [0]https://www.youtube.com/watch?v=9mJAerUL-7w https://www.youtube.com/watch?v=9mJAerUL-7w
- Hugsbox 2mo ago
  Sweet, I love Behind the Bastards, thanks for providing the entertainment for my next few walks :)

arjie 2mo ago

Most people get their moral framework from TV, movies, and memes. Hence the common refrain of “this is just like gattaca” and “have you not seen the movie X? This happens there!” And the torment nexus crap. I call this https://wiki.roshangeorge.dev/w/Story-Logic_Bias https://wiki.roshangeorge.dev/w/Story-Logic_Bias But that seems normal and historical. Stories are how we encode memorable concepts for transmission to each other and probably why the Bible is full of parables and so on. Someone pointed out to me that said Harry Potter fanfiction author has written about this specific bias as well https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logical-fallacy-of-generalization-from-fictional https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logica...

s1artibartfast 2mo ago

That seems like a major misstatement. The likes of Yudkowsky and his types are the primary critic and proponent of regulating the AI industry. How do you reconcile the values of those proposing moratorium up to and including bombing data centers with those who are building them as being the same?