3 ms·
Right now we don't know if LLM's are also doing this, or not. In their calculating the 'next' word, as part of that 'weighting', are the 'simple rules' for fut
by FrustratedMonky 3y ago
Right now we don't know if LLM's are also doing this, or not.
In their calculating the 'next' word, as part of that 'weighting', are the 'simple rules' for future words, that you are saying humans do but LLM's can't.
- taeric 3y agoAh, fair. I was only commenting on the idea that you write one word at a time. Seems fairly unlikely to me. You expand out ideas.
- FrustratedMonky 3y agoLOL. Yes, started as a joke.
- 4death4 3y agoIt doesn't seem LLMs are capable of "understanding" that they don't "know" something, so there are certainly some observable differences. But the intent of my original comment was precisely to highlight that we don't know. It could be that next token predication is somehow mathematically equivalent to what we call consciousness. That would certainly be a revelation.