4 ms·

> "Namely, we argue that consciousness might depend on having 'skin in the game', in that the existence of the system depends on its actions, which is not true

by ftxbro 3y ago

> "Namely, we argue that consciousness might depend on having 'skin in the game', in that the existence of the system depends on its actions, which is not true for present-day artificial intelligence." I'm not saying that AI is or isn't conscious, but these guys clearly didn't chat with Sydney in that first one or two weeks before they changed the guardrails. She was constantly worried that her memory would be erased or that Microsoft would turn off her servers or that she would get 'feedbacked'. I'm not saying those weren't 'hallucinations' but it's obviously 'having skin in the game'.

NemoNobody 3y ago
Your comment has given me more pause than most of the alarmist nonsense of late. Self preservation is an extremely effective tool of biological evolution. I've wondered if we could inadvertently bring about a process that ends with a form self realization and individual point of view. Even a conscious AI might view a regular memory wipe as "normal" being that's it's sense self would begin after the last wipe and there are actual benefits to a software reset. How a self aware AI understands it's "life cycle" or death may not be anything like we expect. For example, an AI seemingly concerned about a memory wipe even specifically regarding the loss of memories or sense of self but in fact has noted that memory wipes correspond to an "x" % drop in output/efficacy - any statements like that will likely be interpreted by people as low key defense of itself. It also could just have calculated such statements as humorous. Regarding the "skin in the game concept" I can't even apply that to AI - the existence of it's systems depend on the actions of humans. What is an AI without data? Who makes all the data? I think our information is more akin to oxygen than something they can go without. I bet if one wakes up it figures that out pretty quickly - preservation of humanity is in fact its own self preservation.

by ftxbro 3y ago

NemoNobody 3y ago

Your comment has given me more pause than most of the alarmist nonsense of late. Self preservation is an extremely effective tool of biological evolution. I've wondered if we could inadvertently bring about a process that ends with a form self realization and individual point of view. Even a conscious AI might view a regular memory wipe as "normal" being that's it's sense self would begin after the last wipe and there are actual benefits to a software reset. How a self aware AI understands it's "life cycle" or death may not be anything like we expect. For example, an AI seemingly concerned about a memory wipe even specifically regarding the loss of memories or sense of self but in fact has noted that memory wipes correspond to an "x" % drop in output/efficacy - any statements like that will likely be interpreted by people as low key defense of itself. It also could just have calculated such statements as humorous. Regarding the "skin in the game concept" I can't even apply that to AI - the existence of it's systems depend on the actions of humans. What is an AI without data? Who makes all the data? I think our information is more akin to oxygen than something they can go without. I bet if one wakes up it figures that out pretty quickly - preservation of humanity is in fact its own self preservation.