35 ms·
I'm working on something where I need to basically add on the order of 150,000 tokens into the knowledge base of an LLM. Finding out slowly I need to delve into
by Beltiras 3y ago
I'm working on something where I need to basically add on the order of 150,000 tokens into the knowledge base of an LLM. Finding out slowly I need to delve into training a whole ass LLM to do it. Sigh.
- RhodesianHunter 3y agoOr, at this rate, just wait 6 months.
- v3ss0n 3y agohttps://deepai.org/publication/scaling-transformer-to-1m-tokens-and-beyond-with-rmt https://deepai.org/publication/scaling-transformer-to-1m-tok... Can this be implemented in current opensource models?
- akvadrako 3y agoCan't you use fine-tuning for this? A other option is to ask GPT to compress your tokens into a shorter prompt for itself.