3 ms·
Slightly off topic: what’s the reasonably smallest LLM model i can use to do language processing and rewriting of a large library of word documents? For the pu
by nashashmi 2y ago
Slightly off topic: what’s the reasonably smallest LLM model i can use to do language processing and rewriting of a large library of word documents? For the purposes of querying information and regurgitating out summaries or detailed information?
My use case is very simple: take 1000 word documents filled with two to three pages of information and pictures. And then output a set of requested information via prompting. Is there something off the shelf? Or do I have to make this?
- ukuina 2y agoSounds like a good RAG use-case unless all 1k documents need to be comprehended simultaneously. Look at H2O.ai: https://github.com/h2oai/h2ogpt https://github.com/h2oai/h2ogpt