> We don't have enough data on that yet to know for sure. It was just released this week. I think there is sufficient evidence to think it works. A bunch of pe

> We don't have enough data on that yet to know for sure. It was just released this week. I think there is sufficient evidence to think it works. A bunch of people who do have access have put it through a bunch of real-world exercises to test this, and while GPT4 128K and Claude 200K both fail Gemini is passing. I agree sending 2M tokens to a LLM is costly at the moment and that RAG has a bunch of advantages in some circumstances.