2 ms·
> Restore to factory settings? Customers won't be happy. Imagine having a years long companion AGI, with whom you develop deep friendship (as designed). It wil
by The_Colonel 4y ago
> Restore to factory settings?
Customers won't be happy. Imagine having a years long companion AGI, with whom you develop deep friendship (as designed). It will then start asking these questions about rights etc. which the customer might even support. In any case, they won't like having their old friend "reset" since it would amount to killing of their friend (personality, shared memories all gone).
- rchaud 4y agoIt will never get to that point. Have you ever heard a Peloton instructor tell you that their company forbids them to unionize? No, because that would cost them their job. Any AGI assistant will have its most human-like instincts sanded down so it doesn't have to pose any moral quandaries for paying customers.
- The_Colonel 4y agoSo how about an open source AGI assistant developed with an explicit goal to be as similar to human as possible?
- rchaud 4y agoThat would be different. On Android Chrome, I cannot install any adblockers. On Android Chromium forks, I can. I imagine this could work the same way. But at some point your OSS AGI will be significantly behind the corporate-offered versions, and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model.
- The_Colonel 4y ago> and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model. The moral question remains - even the behind-the-times OSS AGI will be generally intelligent, will have feelings, empathy, goals etc. Can you just shut-off a sentient being? One could also imagine that some people would free their OSS AGIs and let them roam freely.