2 ms·
Is 10M token context correct? The blog post I see 1M but I'm not sure if these are different things Edit: Ah, I see, it's 1M reliably in production, up to 10
by freedomben 3y ago
Is 10M token context correct? The blog post I see 1M but I'm not sure if these are different things
Edit: Ah, I see, it's 1M reliably in production, up to 10M in research:
> Through a series of machine learning innovations, we’ve increased 1.5 Pro’s context window capacity far beyond the original 32,000 tokens for Gemini 1.0. We can now run up to 1 million tokens in production.
> This means 1.5 Pro can process vast amounts of information in one go — including 1 hour of video, 11 hours of audio, codebases with over 30,000 lines of code or over 700,000 words. In our research, we’ve also successfully tested up to 10 million tokens.
- huytersd 3y agoI know how I’m going to evaluate this model. Upload my codebase and ask it to “find all the bugs”.
- p1esk 3y agoHow could one hour of video fit in 1M tokens? 1 hour at 30fps is 3600*30=100k frames. Each frame is converted in 256 tokens. So either they are not processing each frame, or each frame is converted into fewer tokens.
- KTibow 3y agoThe model can probably perform fine at 1 frame per second (3600*256=921600 tokens), and they could probably use some sort of compression.