No they can't, it's a N^2 algorithm, just fitting it in the context window is a challenge. And sure maybe not 2mil of it is usable, but they're reliably pushin

No they can't, it's a N^2 algorithm, just fitting it in the context window is a challenge. And sure maybe not 2mil of it is usable, but they're reliably pushing the frontier here.