> The 10M context ability wipes out most RAG stack complexity immediately. 1. People mention accuracy issues with longer contexts 2. People mention processing

> The 10M context ability wipes out most RAG stack complexity immediately. 1. People mention accuracy issues with longer contexts 2. People mention processing time issues with longer contexts 3. Something people haven't mentioned in this thread is cost -- even thought prompt tokens are usually cheaper than generated tokens, and Gemini seems to be cheaper than GPT-4, putting a whole knowledge base or 80-page document in the context is going to make every time you run that prompt quite expensive