5 ms·
That's a great tip! Do you happen to have a list of abbreviations for common words? I guess I could ask gpt-4 lmao
by sergiotapia 3y ago
That's a great tip! Do you happen to have a list of abbreviations for common words? I guess I could ask gpt-4 lmao
- fnordpiglet 3y agoSorry I’ve been doing this a bit adhoc - there are other techniques I do as well such as choosing shorter synonyms. A structured approach might be doing a dictionary translation by inverting a thesaurus and mapping synonyms to either themselves or a shorter word. There may be some “texting culture” thesaurus in the world that you could merge with a standard one. But it’s also remarkably resilient to dropping single characters or even a few so long as the spelling is very similar. Wish I had a more rigorous approach for you though.
- phillipcarter 3y agoIt took us quite a bit of work to reduce the static part of our prompt from ~2300 tokens to ~500 tokens. I wish there was a good playbook for this. I used gpt-4 a bit for some ideas, but almost all of it was just getting extremely creative with terse ways to represent info and cut cruft. Additionally, we've learned that LLMs lose a lot of context in the middle of a prompt, and so it might also be that a bunch of data not near the beginning or end of a prompt could just get removed entirely, or at least much more tersely summarized.