4 ms·
The biggest win here has to be the context length increase to 128k from 8k tokens. Till now my understanding is there hasn't been any open models anywhere close
by kingsleyopara 2y ago
The biggest win here has to be the context length increase to 128k from 8k tokens. Till now my understanding is there hasn't been any open models anywhere close to that.
- HanClinto 2y agoIt is notable, but it's not alone. Mistral NeMo just released last week with a 128k context window: https://news.ycombinator.com/item?id=40996058 https://news.ycombinator.com/item?id=40996058
- kingsleyopara 2y agoThanks! Not sure how I missed that :)
- HanClinto 2y agoIt's easy to miss things. Trying to keep up with the latest in AI news is like drinking from the firehose -- it's never-ending.
- cpursley 2y agoPhi 3