5 ms·
> What about that trick where you shrink a whole document of context down to the embedding space of a single token (which is how ChatGPT is remembering the prev
by EForEndeavour 3y ago
> What about that trick where you shrink a whole document of context down to the embedding space of a single token (which is how ChatGPT is remembering the previous conversations)
This is news to me. Where could I read about this trick?
- deleted 3y ago[deleted]