4 ms·
Someone shared this chat with me and it seems like GPT3 has a complete breakdown halfway through?
by hersko 3y ago
Someone shared this chat with me and it seems like GPT3 has a complete breakdown halfway through?
- deleted 3y ago[deleted]
- swyx 3y agoand it recovers too. i wonder if some internals got in a bad state and then it was reset.
- vczf 3y agoChatGPT has a 4k token context window, and some of that might be taken up by scaffolding like the system prompt, autosummary of conversation outside of context window, etc. If you continue the conversation, the gibberish will eventually leave the context window and then no longer directly influence the generations.