3 ms·
On the contrary, ChatGPT appears conversational because it basically feeds the entire chat history into the model to generate each subsequent response.
by jmcphers 4y ago
On the contrary, ChatGPT appears conversational because it basically feeds the entire chat history into the model to generate each subsequent response.
- lelandfe 4y ago...which is to say, that you partition feeding the essay over many prompts? The token limit of the entire chat history is different than what's permitted in a single prompt. Paste in a large amount of text and you'll see it for yourself.
- ShamelessC 4y agoThey use automatic summarization once you exceed said limit to get around this.