3 ms·
> GPT-3 lacks any form of memory. Is that true? How is it able to have the conversation shown in the article about python programming, if it can’t remember tha
by da39a3ee 5y ago
> GPT-3 lacks any form of memory.
Is that true? How is it able to have the conversation shown in the article about python programming, if it can’t remember that the premise of the later questions it is being asked is that it said it has Python programming experience?
- YeGoblynQueenne 5y agoIt is fed each answer it generates as part of the next input. That's why it can't keep that up for too long: the size of its input grows well-kinda-sorta- exponentially quickly until it hits the limit of 2048 tokens. Which is one rason why only diminshing returns can come from increasing computational resources, btw. For inference, anyway. You can see examples of that kind of back-to-back querying and examples of code to do it in one of the links of the article above: https://www.twilio.com/blog/ultimate-guide-openai-gpt-3-language-model https://www.twilio.com/blog/ultimate-guide-openai-gpt-3-lang...