3 ms·
it is pattern matching, the correct output is literally part of the prompt.
by _dain_ 4y ago
it is pattern matching, the correct output is literally part of the prompt.
- kilgnad 4y agoKnowing which component of the prompt is required for the correct output indicates understanding. Especially when given the fact that the prompt as training data doesn't actually exist.
- _dain_ 4y agoI don't want to continue this argument forever but let me make my final thought: I can imagine a language model that can learn how the Linux terminal works but not how English works. I can NOT imagine a language model that can learn how English works but not how a Linux terminal works. English is strictly harder. So the fact that it knows English is already enough, the terminal parts are superfluous.
- kilgnad 4y agoThe more amazing part in that article I was referring to was the imitation of self in the terminal. farewell.