3 ms·
All I see in the link is empty PR claims - is there any information about how they're doing that? There are all kinds of known techniques that "expand" context
by PeterisP 3y ago
All I see in the link is empty PR claims - is there any information about how they're doing that? There are all kinds of known techniques that "expand" context window without really doing so, with different tradeoffs, and unless they provide actual information, any claims should be taken with a pile of salt, we shouldn't just assume that they actually have "true" 100k context windows.