> The question is, when will we feel that those things actually deserve to be thought of as being full-fledged, or at least partly fledged, "I"s? this LLM thi

> The question is, when will we feel that those things actually deserve to be thought of as being full-fledged, or at least partly fledged, "I"s? this LLM thing is more like a collective "we", it is making a prediction in the sense of the relevant training data, it probably wouldn't say anything that contradicts the consensus. Maybe the LLM's are just a mirror of our society. And our society doesn't seem to assign a lot of value to individualism, as such. i think that might be similar to the movie Solaris by Tarkovsky. The movie is starring an alien ocean, which is some sort of mirror, that is showing us who we are (maybe it has a different meaning, not quite sure about it). You can watch it on youtube: https://www.youtube.com/watch?v=Z8ZhQPaw4rE https://www.youtube.com/watch?v=Z8ZhQPaw4rE (i think you also get this theme with Stalker - this zone is also telling us who we are)