4 ms·
You can just advice it to forget (that is, skip in summarization) things which seem irrelevant.
by keskival 3y ago
You can just advice it to forget (that is, skip in summarization) things which seem irrelevant.
- BoorishBears 3y agoOr you could use techniques from the 1970s that let you skip the kind of highly repetitive text that causes them to get stuck without losing important concepts (IDF)
- potatoman22 3y agoThis is interesting. How would you incorporate IDF into an LLM?
- BoorishBears 3y agoBM25F (which is based on IDF) to quickly identify relevant past responses based on the question and reply they got. At each summarization step you can go through and find which Q/A pairs have the highest relevance across all of the other questions in the current batch, which helps solve LLMs tendencies to get stuck in high similar repetitions