"a fast and effective way to have a multi-million-token context window" This truly is the challenge - both to have the huge context window and the ability to c

"a fast and effective way to have a multi-million-token context window" This truly is the challenge - both to have the huge context window and the ability to conduct coherent and comprehensive reasoning using the entire context. We should see soon whether there is a Moore's law effect here: I would be immensely surprised if not.