3 ms·
Wonder if this can be used to communicate with LLMs to reduce token costs.
by Sai_ 3y ago
Wonder if this can be used to communicate with LLMs to reduce token costs.
- sitkack 3y agoThere was some chatter about 9 months ago I think when folks were using compression, unicode and all sorts of weird hacks to increase the context window. This is rather recent, but in the same vein. https://www.microsoft.com/en-us/research/blog/llmlingua-innovating-llm-efficiency-with-prompt-compression/ https://www.microsoft.com/en-us/research/blog/llmlingua-inno... https://twitter.com/VictorTaelin/status/1642664054912155648 https://twitter.com/VictorTaelin/status/1642664054912155648