3 ms·
"I really want to know how they're getting to 10M context, though." My $5 says it's a RAG or a similar technique (hierarchical RAG comes to mind), just like al
by tomaskafka 3y ago
"I really want to know how they're getting to 10M context, though."
My $5 says it's a RAG or a similar technique (hierarchical RAG comes to mind), just like all other large context LLMs.