3 ms·
> there's literally nothing to support your belief that there's anything resembling understanding of the world, having a world model, neurons, thinking, or reas
by dleary 2y ago
> there's literally nothing to support your belief that there's anything resembling understanding of the world, having a world model, neurons, thinking, or reasoning in LLMs.
The link mentions "a feature that triggers on the Golden Gate Bridge".
As a test case, I just drew this terrible doodle of the Golden Gate Bridge in MS paint: https://imgur.com/a/1TJ68JU https://imgur.com/a/1TJ68JU
I saved the file as "a.png", opened the chatgpt website, started a new chat, uploaded the file, and entered, "what is this?"
It had a couple of paragraphs saying it looked like a suspension bridge. I said "which bridge". It had some more saying it was probably the GGB, based on two particular pieces of evidence, which it explained.
https://imgur.com/a/sWwWlxO https://imgur.com/a/sWwWlxO
> The model recognizes nothing, and groups nothing
Then how do you explain the interaction I had with chatgpt just now? It sure looks to me like it recognized the GGB from my doodle.
- habinero 2y agoYou're Clever Hans-ing yourself into thinking there's more going on than there is. Machine learning models can do this and have been for a long time. The only thing different here is there's some generated text to go along with it with the "reasoning" entirely made up ex post facto
- troupo 2y ago> Then how do you explain the interaction I had with chatgpt just now? Predominantly English-language data set with one of the most famous suspension bridges in the world? How can anyone explain the clustering of data on that? Surely it's the model of the world, and thinking, and neurons. What happens if you type "most famous suspension bridges in the world" into Google and click the first ten or so links? It couldn't be literally the same data? https://imgur.com/a/tJ29rEC https://imgur.com/a/tJ29rEC