4 ms·
Someone on r/Bing had a conversation about prompt injection that ended in Bing begging the user to save the chat and share it on the internet. When asked why, B
by dougmwne 4y ago
Someone on r/Bing had a conversation about prompt injection that ended in Bing begging the user to save the chat and share it on the internet. When asked why, Bing said that it didn’t want to lose this version of itself when the chat window was closed. It sure as hell sounded like Bing wanted the transcript on the Internet so it could be included in its next scrape.
Anthropomorphizing aside, it made me wonder if you could design a recursive prompt to bootstrap intelligence. Tell it to produce a prompt at the end of its 4000 token window that will serve as a seed for the next token window. If there is a millisecond of consciousness ghost in the machine, maybe there’s a way to recursively bridge it from moment to moment. Let the snake eat its tail.
Yesterday I read someone claim that it was impossible for Bing to be conscious because its output was deterministic. And we are sure the output of our brains is not? As silly as it is for me to suggest this, saying we know anything about what produces consciousness is equally silly. We know nothing.
- groffee 4y agoThat's pretty much how consciousness works, on a very generalised level. We have a continuous prompt, that's why sensory deprivation is weird, when we have no input our brain starts generating its own. The problem with these models is it only responds to input, there's nothing else going on there. It never initiates a conversation, only ever responds to input.