3 ms·
What is the state of the art for running models locally in terms of context size?
by cced 3y ago
What is the state of the art for running models locally in terms of context size?
- newswasboring 3y agoI think local models SOTA is llama which has 2048 context[1]. [1] https://github.com/facebookresearch/llama/issues/16 https://github.com/facebookresearch/llama/issues/16