3 ms·
AGI clearly has a connotation of sentience and intent, of general intelligence - as opposed to a tool, however intricate. Read Nick Bostrom (yes I know, as a pe
by catoc 4y ago
AGI clearly has a connotation of sentience and intent, of general intelligence - as opposed to a tool, however intricate. Read Nick Bostrom (yes I know, as a person he's cancelled, probably even rightly so, still scientifically relevant reference; and totally not a discussion I want to get into further here, pls)
- antibasilisk 4y agoBut LLMs have been proven to demonstrate intent, and sentience is a philosophical question that doesn't really make any meaningful difference outside of questions of morality.
- bootsmann 4y ago>But LLMs have been proven to demonstrate intent I'd like to see this proof. Everything we've seen so far is just the AI reproducing what humans do, which happens to be writing with intent.
- antibasilisk 4y agoThe two are not meaningfully distinguishable on a materialistic level.
- catoc 4y agoI would say that the strings that are output by LLMs may fluently describe intent and purpose, but that actual intent requires a self awareness that utterly absent. Just like the constant annoying 'apologies' do not in any way signify the model actually feels sorry.
- pixl97 4y ago>Just like the constant annoying 'apologies' do not in any way signify the model actually feels sorry. So your average corporation? >I would say that the strings that are output by LLMs may fluently describe intent and purpose, but that actual intent requires a self awareness that utterly absent The only reason I only partially/somewhat agree with this is current LLMs have no learning feedback loop as a means of short term actions to long term improvement. The moment that changes I'll take your statement and throw it in the trash bin of history. LLMs output have no (at least self-)purpose because they are just text output. The moment that text output goes to tooling, that tooling performs actions, and those actions are fed back into training the model then purpose is given. The self awareness loop is complete.
- antibasilisk 4y agoI don't agree that intent requires self-awareness.
- logifail 4y ago> LLMs have been proven to demonstrate intent [..] That's quite the claim. Can you provide references?
- antibasilisk 4y agoThere are earlier papers, but page 15 of the GPT-4 paper demonstrates this.