2 ms·
It could work if ChatGPT is able to access storage so it could create its compression dictionary
by tehlike 4y ago
It could work if ChatGPT is able to access storage so it could create its compression dictionary
- mistercow 4y agoYeah, but presumably the main point of compressing a prompt is not to consume your token quota. If the model has to decompress the prompt first, then it will use up just as many tokens, plus the length of the compressed version.