4 ms·
code from the paper https://arxiv.org/abs/2401.18059 https://arxiv.org/abs/2401.18059 It introduces a novel approach of recursively embedding, clustering, and
by homarp 3y ago
code from the paper https://arxiv.org/abs/2401.18059 https://arxiv.org/abs/2401.18059
It introduces a novel approach of recursively embedding, clustering, and summarizing chunks of text, constructing a tree with differing levels of summarization from the bottom up. At inference time, the model retrieves from this tree, integrating information across lengthy documents at different levels of abstraction.