Agreed with this. The leading ability AI (in terms of cognitive power) will, generally, cost more per token than lower cognitive power AI. That means that at

Agreed with this. The leading ability AI (in terms of cognitive power) will, generally, cost more per token than lower cognitive power AI. That means that at a given budget you can choose more cognitive power with fewer tokens, or less cognitive power with more tokens. For most use cases, there's no real point in giving up cognitive power to include useless tokens that have no hope of helping with a given question. So then you're back to the question of: how do we reduce the number of tokens, so that we can get higher cognitive power? And that's the entire field of information retrieval, which is the most important part of RAG.