I was able to create a GPT-4 based bot initally based on knowledge base that provides accurate information. To do this, I first converted a knowledge base artic

I was able to create a GPT-4 based bot initally based on knowledge base that provides accurate information. To do this, I first converted a knowledge base article into a question and answer (Q&A) format using GPT-4 - quick explanation and article link if necessary. Then, I used the API to generate more Q&A pairs by asking GPT-4 to predict what users might ask and create corresponding answers. On my side I now search for the most relevant Q&A pair based on the embedding of user's input and QA and jam as much as I can into the token limit. It provides accurate answers 99% of the time. If it can't find a suitable answer, it may create a plausible response on the spot, but that's getting rarer as training set grows. To prevent the bot from providing incomplete information, you can instruct it to ask users to contact support via email if it doesn't have enough information - either prompt engineering or examples in training set. Alternatively, you can have the bot insert a token like "%%TICKET%%" which you can later use to open a support ticket, summarizing the conversation and attaching relevant chat history, logs, etc.