3 ms·
Strict deterministic output for a given prompt prevents the use of RAG, which increasingly limits the relative utility of a LLM within an organization.
by bpodgursky 9mo ago
Strict deterministic output for a given prompt prevents the use of RAG, which increasingly limits the relative utility of a LLM within an organization.
- qayxc 9mo agoHow so? RAG is just a mechanism for querying external data sources. I don't see any need for non-determinism there.