2 ms·
That would really only work on intrusive prompts, before existing state had been established. It also would not create the non deterministic responses users ha
by flangola7 4y ago
That would really only work on intrusive prompts, before existing state had been established.
It also would not create the non deterministic responses users have come to expect.
- capableweb 4y ago> It also would not create the non deterministic responses users have come to expect. Probably slightly modifying text is less expensive than coming up with brand new text. So the text can be cached, and when retrieved, slightly altered before served. A "cached-but-not-really" cache
- mirekrusin 4y agoGood point, randomly rephrase slightly is probably much easier task resource wise.
- vineyardmike 4y ago> before existing state had been established. As I understand it, "state" is actually just feeding in the history into the prompt as "context", so realistically this could help build history and context via lookups eg. Answer this as an assistant, blah blah blah. You already said ${QUERY 1}, ${QUERY 2}. Refer to ${QUERY 3}, ${QUERY 4} for ideal formatting. Prompt: "This is what the user asks chat gpt this round"