4 ms·
That's not how you do it. You use a Vectordatabase and a Retriever. This way, not all tokens of a document are used with the prompt, just the relevant parts wil
by reneberlin 2y ago
That's not how you do it. You use a Vectordatabase and a Retriever. This way, not all tokens of a document are used with the prompt, just the relevant parts will end up in the conversation / prompts. This way you save a lot of money and you are NOT limited to use GoogleAI - you can use whatever AI you want.
- infecto 2y agoThis is probably how you would do entity extraction. Why would you rag on entity extraction?