4 ms·

Has this philosophical approach ever worked? It's a commonplace in the hard sciences and engineering fields (ie, refusing to work on weapons systems), but weapo

by tptacek 2mo ago

Has this philosophical approach ever worked? It's a commonplace in the hard sciences and engineering fields (ie, refusing to work on weapons systems), but weapons systems are elite and well-compensated engineering projects that don't have any trouble finding talent. The same thing goes for NSA, which has a line out the door from elite academia. I'm not dismissing the sentiment here. It's morally sound. You should act in accordance with your principles and it useful to be reminded how those principles intersect the world. I have similar guardrails (probably not the same as the author's). I just wouldn't want people to overestimate what can be accomplished with this approach.

m-ee 2mo ago
A significant number of people in positions of power in the AI industry get their moral framework from science fiction books and a particular Harry Potter fanfiction. It’s hard to predict what ideas and philosophies will become important.
- Hugsbox 2mo ago
  Sorry, purely just curious here because I'm not sure what you mean - what Harry Potter fanfiction?
  - krapp 2mo ago
    "Harry Potter and the Methods of Rationality" written by Eliezer Yudkowsky has become something akin to a sacred text among the rationalist community. edit: posted is a podcast by Behind the Bastards about the Zizians, a death cult that branched out of rationalist community and which was responsible for six deaths, but it covers the rationalist community and the Harry Potter fanfiction as well. [0]https://www.youtube.com/watch?v=9mJAerUL-7w https://www.youtube.com/watch?v=9mJAerUL-7w
    - Hugsbox 2mo ago
      Sweet, I love Behind the Bastards, thanks for providing the entertainment for my next few walks :)
- arjie 2mo ago
  Most people get their moral framework from TV, movies, and memes. Hence the common refrain of “this is just like gattaca” and “have you not seen the movie X? This happens there!” And the torment nexus crap. I call this https://wiki.roshangeorge.dev/w/Story-Logic_Bias https://wiki.roshangeorge.dev/w/Story-Logic_Bias But that seems normal and historical. Stories are how we encode memorable concepts for transmission to each other and probably why the Bible is full of parables and so on. Someone pointed out to me that said Harry Potter fanfiction author has written about this specific bias as well https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logical-fallacy-of-generalization-from-fictional https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logica...
- s1artibartfast 2mo ago
  That seems like a major misstatement. The likes of Yudkowsky and his types are the primary critic and proponent of regulating the AI industry. How do you reconcile the values of those proposing moratorium up to and including bombing data centers with those who are building them as being the same?
throwlifeaway 2mo ago
[dead]

by tptacek 2mo ago

m-ee 2mo ago

A significant number of people in positions of power in the AI industry get their moral framework from science fiction books and a particular Harry Potter fanfiction. It’s hard to predict what ideas and philosophies will become important.

Hugsbox 2mo ago
Sorry, purely just curious here because I'm not sure what you mean - what Harry Potter fanfiction?
- krapp 2mo ago
  "Harry Potter and the Methods of Rationality" written by Eliezer Yudkowsky has become something akin to a sacred text among the rationalist community. edit: posted is a podcast by Behind the Bastards about the Zizians, a death cult that branched out of rationalist community and which was responsible for six deaths, but it covers the rationalist community and the Harry Potter fanfiction as well. [0]https://www.youtube.com/watch?v=9mJAerUL-7w https://www.youtube.com/watch?v=9mJAerUL-7w
  - Hugsbox 2mo ago
    Sweet, I love Behind the Bastards, thanks for providing the entertainment for my next few walks :)
arjie 2mo ago
Most people get their moral framework from TV, movies, and memes. Hence the common refrain of “this is just like gattaca” and “have you not seen the movie X? This happens there!” And the torment nexus crap. I call this https://wiki.roshangeorge.dev/w/Story-Logic_Bias https://wiki.roshangeorge.dev/w/Story-Logic_Bias But that seems normal and historical. Stories are how we encode memorable concepts for transmission to each other and probably why the Bible is full of parables and so on. Someone pointed out to me that said Harry Potter fanfiction author has written about this specific bias as well https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logical-fallacy-of-generalization-from-fictional https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logica...
s1artibartfast 2mo ago
That seems like a major misstatement. The likes of Yudkowsky and his types are the primary critic and proponent of regulating the AI industry. How do you reconcile the values of those proposing moratorium up to and including bombing data centers with those who are building them as being the same?

throwlifeaway 2mo ago

[dead]