2 ms·
Context “engineering” likely should involve knowing how the llm treats context size, say needle in hay stack performance, how context size affect hallucination
by m3kw9 1y ago
Context “engineering” likely should involve knowing how the llm treats context size, say needle in hay stack performance, how context size affect hallucination rate, when to summerize context instead of entering the full thing.