2 ms·
To answer a query, your LLM needs to "read" the documents first. The context window will not be big enough for this, so you have to fine tune the model. Proble
by Fiahil 3y ago
To answer a query, your LLM needs to "read" the documents first. The context window will not be big enough for this, so you have to fine tune the model.
Problem is, you need to cross-check with the reference material in case it's subject to hallucinations.
- quacked 3y agoOh, I was thinking that the cross-checking is the point. You'd use the LLM as a "hazily thinking search function" to narrow your examination of old documents, not as a replacement for reading the documents. I don't know what to do about the context window, though.
- eternauta3k 3y agoI don't understand, can't you feed it one page at a time and ask it "is there relevant information here?"
- regularfry 3y agoOr load it all into a RAG system. Give it a few months and it'll be something you can buy off the shelf.