3 ms·
> produce writing not by thinking but by making statistically informed guesses about which lexical item is likely to follow another What does "thinking" even m
by jenadine 1y ago
> produce writing not by thinking but by making statistically informed guesses about which lexical item is likely to follow another
What does "thinking" even mean? It turns out that some intelligence can emerge from this stochastic process. LLM can do math and can play chess despite not trained for it. Is that not thinking?
Also, could it be possible that are our brains do the same: generating muscle output or spoken output somehow based on our senses and some "context" stored in our neural network.
- cwillu 1y agoI'm sympathetic to this line of reasoning, but “LLM can play chess” is overstating things, and “despite not being trained for it” is understating how many chess games and books would be in the training set of any LLM. While it's been a few months since I've tested, the last time I tested the reasoning on a game for which very little data is available in book or online text, I was rather underwhelmed with openai's performance.