You can persist the knowledge you would normally retrieve dynamically and inject into the context at runtime via finetuning directly into the model weights. Thi

You can persist the knowledge you would normally retrieve dynamically and inject into the context at runtime via finetuning directly into the model weights. This means you won't have to pull in a glob of additional data with every prompt, but only need to push the query through, which can be answered by the data persisted in the weights. However, as others have pointed out, you lose the ability to reference sources reliably and the output is much more prone to hallucination.