4 ms·
There are at least two distinct workloads for ChatGPT: 1) No context, general knowledge workloads, 2) Contextual workloads using either RAG or direct input of c
by CharlieDigital 2y ago
There are at least two distinct workloads for ChatGPT: 1) No context, general knowledge workloads, 2) Contextual workloads using either RAG or direct input of context.
In general, GPT will not hallucinate or give bad responses on the latter since it's working from a specific corpus of information (whether from RAG or from some context directly provided by the user). This is, of course, not foolproof since some of it is dependent on a good prompt and some of it is dependent on the question (GPT is well known to be poor at math, for example). But for summarization, it is exceedingly good.
The former is where it can tend to hallucinate and generate bad responses.