3 ms·
But the GP is talking about specific properties of large language models like GPT-3. A laptop is indeed a self-maintaining, self-monitoring system, at a low lev
by joe_the_user 5y ago
But the GP is talking about specific properties of large language models like GPT-3. A laptop is indeed a self-maintaining, self-monitoring system, at a low level. A large language model isn't that. It is just a map from input to output and doesn't keep track of it's previous output or input.
- shawnz 5y agoGPT-3 actually does track the previous 2048 tokens of input and output for context.