3 ms·
I think any such systems -- at the moment -- will try to avoid having to fine-tune the completion model, which leads to this kind of solutions: 1. Semantically
by usgroup 3y ago
I think any such systems -- at the moment -- will try to avoid having to fine-tune the completion model, which leads to this kind of solutions:
1. Semantically index your documents.
2. Given a prompt, extract relevant paragraphs from your own documents.
3. Frame a context for the prompt from extracted paragraphs.
4. Ask ChatGPT to answer the prompt, mindful of the context.
That way ChatGPT can be used out-of-the-box.
- usgroup 3y agoBare in mind that this approach is very limited. Any query requiring global awareness of the context will likely be disappointing. For example, "how was the experimental design different compared to how we've previously done this sort of work?", over a corpus of design of experiments specifications. Since target of this query doesn't have any simple correspondence to the words used in the query any sort of semantic embedding at a paragraph of sentence level just won't be useful.