Good question, I was wondering the same. My hunch would be that even if we had a lot more annotated examples of reasoning and retrieval over 10,000+ tokens, th

Good question, I was wondering the same. My hunch would be that even if we had a lot more annotated examples of reasoning and retrieval over 10,000+ tokens, the architectures we have today would still be limited.