The thing is, factual knowledge can be filled in with some RAG pretty easily. It is much harder to impart correct reasoning traces through something like RAG. I

The thing is, factual knowledge can be filled in with some RAG pretty easily. It is much harder to impart correct reasoning traces through something like RAG. I'd much rather have the base model be a stronger reasoner, and bring my facts to the model.