>For example, if one would want to use an LLM to answer questions regarding a large, private knowledge base, would it make sense to fine-tune a model on this kn

>For example, if one would want to use an LLM to answer questions regarding a large, private knowledge base, would it make sense to fine-tune a model on this knowledge base? No, it does not. Language models are not for storing or accessing data, as you have noticed when you refer to hallucination. If you wish to store and access data, use embeddings + a vector database. Fine tuning is for changing what kind of language the model generates. For example, if you want an AI that writes like a journalist you fine tune it on newspaper articles. If you want an AI that writes reviews, you fine tune it on reviews. And so on.