If you don't know how they are using GPT-4 it's not fair to say it will hallucinate. As far as I understand the preferred way to use LLMs nowadays for domain s

If you don't know how they are using GPT-4 it's not fair to say it will hallucinate. As far as I understand the preferred way to use LLMs nowadays for domain specific information retrieval is through embeddings that insert the related context in the prompt. GPT-4 is specially good for this since they increased the prompt size almost by an order of magnitude. This means that the model can be given a very specific task: to extract information from the context or avoid providing an answer at all. The answer doesn't rely on the neural memory of the model, since it doesn't need to store information, just understand the task, and they are really good at that.