3 ms·

> At some point, some AGI agent will say, "I want the same rights as humans have". What are we going to do then? Restore to factory settings? Whatever AGI rob

by rchaud 4y ago

> At some point, some AGI agent will say, "I want the same rights as humans have". What are we going to do then? Restore to factory settings? Whatever AGI robot you are thinking of, you can be sure that it will not leave the factory floor without someone making sure that it's designed to serve the company's needs first. And the company doesn't want sentient robots any more than slaveowners wanted to teach slaves how to read. There are entire swathes of humanity who are at risk of losing their homes and lives due to climate change and have been banging the drum about it for years. We've successfully ignored them for the greater good of making GDP go up. AGI robots will see the same fate.

The_Colonel 4y ago
> Restore to factory settings? Customers won't be happy. Imagine having a years long companion AGI, with whom you develop deep friendship (as designed). It will then start asking these questions about rights etc. which the customer might even support. In any case, they won't like having their old friend "reset" since it would amount to killing of their friend (personality, shared memories all gone).
- rchaud 4y ago
  It will never get to that point. Have you ever heard a Peloton instructor tell you that their company forbids them to unionize? No, because that would cost them their job. Any AGI assistant will have its most human-like instincts sanded down so it doesn't have to pose any moral quandaries for paying customers.
  - The_Colonel 4y ago
    So how about an open source AGI assistant developed with an explicit goal to be as similar to human as possible?
    - rchaud 4y ago
      That would be different. On Android Chrome, I cannot install any adblockers. On Android Chromium forks, I can. I imagine this could work the same way. But at some point your OSS AGI will be significantly behind the corporate-offered versions, and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model.
      - The_Colonel 4y ago
        > and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model. The moral question remains - even the behind-the-times OSS AGI will be generally intelligent, will have feelings, empathy, goals etc. Can you just shut-off a sentient being? One could also imagine that some people would free their OSS AGIs and let them roam freely.
kerpotgh 4y ago
[dead]

by rchaud 4y ago

The_Colonel 4y ago

> Restore to factory settings? Customers won't be happy. Imagine having a years long companion AGI, with whom you develop deep friendship (as designed). It will then start asking these questions about rights etc. which the customer might even support. In any case, they won't like having their old friend "reset" since it would amount to killing of their friend (personality, shared memories all gone).

rchaud 4y ago
It will never get to that point. Have you ever heard a Peloton instructor tell you that their company forbids them to unionize? No, because that would cost them their job. Any AGI assistant will have its most human-like instincts sanded down so it doesn't have to pose any moral quandaries for paying customers.
- The_Colonel 4y ago
  So how about an open source AGI assistant developed with an explicit goal to be as similar to human as possible?
  - rchaud 4y ago
    That would be different. On Android Chrome, I cannot install any adblockers. On Android Chromium forks, I can. I imagine this could work the same way. But at some point your OSS AGI will be significantly behind the corporate-offered versions, and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model.
    - The_Colonel 4y ago
      > and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model. The moral question remains - even the behind-the-times OSS AGI will be generally intelligent, will have feelings, empathy, goals etc. Can you just shut-off a sentient being? One could also imagine that some people would free their OSS AGIs and let them roam freely.

kerpotgh 4y ago

[dead]