This is grossly untrue in a way that denotes surface-level familiarity on several fronts You're referring to the needle-in-a-haystack retrieval problem. Which

This is grossly untrue in a way that denotes surface-level familiarity on several fronts You're referring to the needle-in-a-haystack retrieval problem. Which the person you're replying to explicitly mentioned is the only benchmark providers are using, for good reason. Consider the "translate Moby Dick to comedic zoomer" problem. This does not even come remotely close to working unless I do it in maximum chunks of 5,000 tokens. Consider the API output limit of 4096 tokens, across all providers. And no, you shouldn't assume effectively infinite (RAG free) context in the near future. This time last year, Anthropic was demonstrating 120,000 token context. It released 200K a few weeks ago. And runtime cost scales with N^2.