3 ms·

Can't help but recall a relative episode of StarTrek in which an AI computer takes control of the Enterprise and starts targeting friendlies as it classifies th

by Zenst 7y ago

Can't help but recall a relative episode of StarTrek in which an AI computer takes control of the Enterprise and starts targeting friendlies as it classifies them as hostile. https://en.wikipedia.org/wiki/The_Ultimate_Computer https://en.wikipedia.org/wiki/The_Ultimate_Computer

outworlder 7y ago
This actually reminds me of an episode of Start Trek: Voyager (Dreadnaught). A missile with an advanced AI gets transported to the Delta quadrant in the same way as Voyager was. It was already en-route to a target planet. Obviously it lost lock. It then used what information it had about the planet to find it again. It found it – except it wasn't the same planet, it was a completely innocent one. And set a course. It correctly calculated that the probability of two planets having the exact same parameters was infinitesimally small, so it must be the correct target. It was further unconvinced that it was, in fact, in the Delta quadrant. It also disregarded the orders to shut down, which came from the same engineer who reprogrammed it, believing that she was a rogue agent. https://memory-alpha.fandom.com/wiki/Dreadnought_(episode) https://memory-alpha.fandom.com/wiki/Dreadnought_(episode)
- Zenst 7y ago
  Ah yes, I remember that one, more you think about it - this lesson has been played out many times in various scifi forms. Even to the extreme of Terminator and skynet. Makes you wonder what will play out in real life as we go into the AI age.
  - jandrese 7y ago
    Or if it has already played out many times in history as people operating on incomplete information have made bad decisions and then stuck with them even in the face of newly incoming conflicting data. Really the worry here is that AIs will be just as bad at decision making as humans. A semi-recent example is the shooting down of MH17, which was shot down by Russians or their allies because they mistook an airliner for a military aircraft, even when their flight profiles were totally different. The controllers were expecting a military aircraft to arrive around that time and didn't stop to consider the alternatives, even when the target didn't behave properly.
    - Zenst 7y ago
      Yes the classic 60's saying from computers "Garbage In Garbage Out" still holds true. Though today we can process that garbage faster and react faster - what could go wrong.
  - kingkawn 7y ago
    Everything we’ve imagined we’ll do

by Zenst 7y ago

outworlder 7y ago

This actually reminds me of an episode of Start Trek: Voyager (Dreadnaught). A missile with an advanced AI gets transported to the Delta quadrant in the same way as Voyager was. It was already en-route to a target planet. Obviously it lost lock. It then used what information it had about the planet to find it again. It found it – except it wasn't the same planet, it was a completely innocent one. And set a course. It correctly calculated that the probability of two planets having the exact same parameters was infinitesimally small, so it must be the correct target. It was further unconvinced that it was, in fact, in the Delta quadrant. It also disregarded the orders to shut down, which came from the same engineer who reprogrammed it, believing that she was a rogue agent. https://memory-alpha.fandom.com/wiki/Dreadnought_(episode) https://memory-alpha.fandom.com/wiki/Dreadnought_(episode)

Zenst 7y ago
Ah yes, I remember that one, more you think about it - this lesson has been played out many times in various scifi forms. Even to the extreme of Terminator and skynet. Makes you wonder what will play out in real life as we go into the AI age.
- jandrese 7y ago
  Or if it has already played out many times in history as people operating on incomplete information have made bad decisions and then stuck with them even in the face of newly incoming conflicting data. Really the worry here is that AIs will be just as bad at decision making as humans. A semi-recent example is the shooting down of MH17, which was shot down by Russians or their allies because they mistook an airliner for a military aircraft, even when their flight profiles were totally different. The controllers were expecting a military aircraft to arrive around that time and didn't stop to consider the alternatives, even when the target didn't behave properly.
  - Zenst 7y ago
    Yes the classic 60's saying from computers "Garbage In Garbage Out" still holds true. Though today we can process that garbage faster and react faster - what could go wrong.
- kingkawn 7y ago
  Everything we’ve imagined we’ll do