4 ms·
Agreed, you can try sending it in chunks but then you lose context. Perhaps the ChatGPT based API will help if they expose the conversational memory as a featur
by cloudking 4y ago
Agreed, you can try sending it in chunks but then you lose context. Perhaps the ChatGPT based API will help if they expose the conversational memory as a feature.
Maybe OP has figured out a method with the current API?
- peytoncasper 4y agoI saw in another thread that people were working around this by asking for a summary of sections and then combining the summaries and asking for a joint summary. Kind of like map reducing the articles.
- sudoelefant 4y agoO believe this is how GPT-Index attempts to bypass prompt length limitations.
- k1m 4y agoThis is an issue. I haven't experimented to see if there are workarounds, so the service currently checks the length of the article text and if it's very long, it will send a portion, otherwise we'll exceed the token limit. There's a note on the front page about it: "Limitations: The OpenAI API does not allow submission of large texts, so summarization may only be based on a portion of the whole article."
- roflyear 4y agoChatGPT doesn't seem to have a much longer memory
- gamegoblin 4y agoIt's 2x the length of GPT3. 8192 tokens vs 4096.
- ijidak 4y agoNot promoting this. But, sounds like a great area for monetization. Anyone can use without conversational memory, or with limited conversational memory. Then, charge for larger conversational memory.