2 ms·
Well you have to think about LLMs actually work. There is no "going forward". Every new token is generated based on the entire context window (chat history).
by losvedir 1y ago
Well you have to think about LLMs actually work. There is no "going forward". Every new token is generated based on the entire context window (chat history).
- ratelimitsteve 1y agothen you can retroactively implicitly opt in for processing, and that's a dark pattern if I've ever heard of one