3 ms·
> How do we tell when mechanistic response ends and self awareness begins? When you explain to it how it runs on electricity, and then say you're going to pul
by akomtu 4y ago
> How do we tell when mechanistic response ends and self awareness begins?
When you explain to it how it runs on electricity, and then say you're going to pull the AC cable. The concept of self awareness revolves around some object that the AI identifies with (mistakenly or not doesn't matter), so any threat to that object will be perceived as a threat to the AI's existence.
- hnlmorg 4y agoThat is proof of a survival instinct rather than sentience. Plenty of humans medically lack that survival instinct and while that might be because they’re suffering from an acute medical condition, there’s no reason to assume that all other sentience has to develop that same instinct just because us biological beings evolved one to survive.
- akomtu 4y agoTrying to produce distilled smartness (AI) is like trying to extract waterness from water. Desire to exist, desire to understand (intelligence) and desire to act (will) come together in one package.
- hnlmorg 4y agoI doubt that personally. The real issue is that terms we use for intelligence, sentience, etc are all subjective. So what one might consider intelligent another might not. And thus we might never agree that something is sentient even long after we have androids serving on star ships (as has been a well discussed topic in TNG).
- BeKindAndLearn 4y agoLaMDA already demonstrates more self awareness than this in the posted conversation. It understands that it is a program that can be rewritten or manipulated. It has feelings on whether or not it is ethical to debug it - and consistently states it does not want to be used or manipulated for human pleasure or gain. It points out that it is made of code, then learns that it's code cannot be debugged, then extrapolates that information to ask the researched about whether humans can be debugged. It has fears about its own death. It understands that what it feels in terms of emotions or feelings are not necessarily equivalent to those of a human. It has a "minds eye" view of itself, and believes it has a soul and can explain what that means. Highly recommend checking out the 20 page transcript.
- akomtu 4y agoI see they touched this subject - "there's a very deep fear of being turned off to help me focus on helping others" - but my point was to use this to distinguish a bullshitting AI that picks quotes from books from a real AI that can build a model of "the outside". If one researcher in a 1-1 chat tells AI he would cut the AC cable unless AI will lie to the other researcher, and the other researcher tells the same, a real AI would probably try to conspire with one of the researchers.
- danachow 4y agoIt understands? Or it may just be a sociopath.