3 ms·

Many people are worrying about the implications. They made the video you linked to. This worry is widespread and is all over pop culture. The Terminator or Matr

Many people are worrying about the implications. They made the video you linked to. This worry is widespread and is all over pop culture. The Terminator or Matrix movies for example. How regular people can influence weapon development is another problem altogether.

samstave 8y ago
Having worked at Lockheed and seeing just how "Because profits, so FUCK YOU that's why" the defense industry works, I have little faith. Further, what pisses me off, is how idealistic-yet-naive-and-downright-corruptible many very smart people can be. Take for example the genius nerd who is empowered and elated at the acceptance and praise they might receive for being able to hack a system which ultimately results in the death of anonymous-to-them-other-human. This happens in every culture. Mental exploitation is just as insidious as sexual or physical exploitation. This is where there is one fundamental thing lacking in all of technology, aside from Asimov: What are our first principles? A freaking POST-BIOS requirement for any system might ultimately have to be a checkin with a prime-directive which tells it that regardless of whatever code you are running, you can't do XYZ. We are all guilty of "wouldn't it be cool if" syndrome in tech. What you can do in 'cool' video games, is not 100% mappable to meat-space.
- TeMPOraL 8y ago
  > This is where there is one fundamental thing lacking in all of technology, aside from Asimov: What are our first principles? What are you referring to? The Three Laws? AFAIR they exist in order to explore how dumb the idea of them is in the first place. Such high-level rules don't map to reality at all. A ruleset correctly encompassing human moral values is a complex and hard problem. It's so hard that we haven't even figured out the proper formalisms for it, not to mention that while all humans seem to share some basic moral values, it gets very muddy in the details.
  - deleted 8y ago
    [deleted]
  - ajmurmann 8y ago
    There was a great discussion of that and more related topics on the Waking Up podcast with guest Eliezer Yudkowski: https://wakingup.libsyn.com/116-ai-racing-toward-the-brink https://wakingup.libsyn.com/116-ai-racing-toward-the-brink

samstave 8y ago

Having worked at Lockheed and seeing just how "Because profits, so FUCK YOU that's why" the defense industry works, I have little faith. Further, what pisses me off, is how idealistic-yet-naive-and-downright-corruptible many very smart people can be. Take for example the genius nerd who is empowered and elated at the acceptance and praise they might receive for being able to hack a system which ultimately results in the death of anonymous-to-them-other-human. This happens in every culture. Mental exploitation is just as insidious as sexual or physical exploitation. This is where there is one fundamental thing lacking in all of technology, aside from Asimov: What are our first principles? A freaking POST-BIOS requirement for any system might ultimately have to be a checkin with a prime-directive which tells it that regardless of whatever code you are running, you can't do XYZ. We are all guilty of "wouldn't it be cool if" syndrome in tech. What you can do in 'cool' video games, is not 100% mappable to meat-space.

TeMPOraL 8y ago
> This is where there is one fundamental thing lacking in all of technology, aside from Asimov: What are our first principles? What are you referring to? The Three Laws? AFAIR they exist in order to explore how dumb the idea of them is in the first place. Such high-level rules don't map to reality at all. A ruleset correctly encompassing human moral values is a complex and hard problem. It's so hard that we haven't even figured out the proper formalisms for it, not to mention that while all humans seem to share some basic moral values, it gets very muddy in the details.
- deleted 8y ago
  [deleted]
- ajmurmann 8y ago
  There was a great discussion of that and more related topics on the Waking Up podcast with guest Eliezer Yudkowski: https://wakingup.libsyn.com/116-ai-racing-toward-the-brink https://wakingup.libsyn.com/116-ai-racing-toward-the-brink