2 ms·
> "hundreds of thousands to potentially millions of tokens" - that's the same order as current commercial LLMs. Yes, but those are all relying on proprietary c
by cubefox 1y ago
> "hundreds of thousands to potentially millions of tokens" - that's the same order as current commercial LLMs.
Yes, but those are all relying on proprietary company secrets, while this is an open research paper. Besides, only Gemini so far has a context window of more than a million tokens.
- littlestymaar 1y agoLlama 4 Scout has it also, and is an open weight LLM, unfortunately it is also disappointing at pretty much any context length…