4 ms·
You use a vector database with a query similarity search to find portions of documents that might be relevant to your prompt, rank them, take the top n, put the
by treprinum 3y ago
You use a vector database with a query similarity search to find portions of documents that might be relevant to your prompt, rank them, take the top n, put them into the context and run through your LLM to generate an answer to your question.
- fzliu 3y agoThis paradigm applies for much more than just answering questions - I've found the in-context learning capabilities to be very relevant as well. For example, you can query a vector database and input that information into an LLM and ask it to make a prediction across the input data. https://zilliz.com/blog/ChatGPT-VectorDB-Prompt-as-code https://zilliz.com/blog/ChatGPT-VectorDB-Prompt-as-code