This sounds like a paradox - but it is not. You don't give the bot the answer you expect - but only the ground facts, it generates the answer based on these fac

This sounds like a paradox - but it is not. You don't give the bot the answer you expect - but only the ground facts, it generates the answer based on these facts by itself. This is a RAG system - and you need to treat it as a whole - it is an question answering machine that remembers the whole wikipedia. By the way just today I wrote a blogpost about the common misconception that to teach an LLM new facts you need to finetune it: https://zzbbyy.substack.com/p/why-you-need-rag-not-finetuning https://zzbbyy.substack.com/p/why-you-need-rag-not-finetunin...