3 ms·
I love the idea of a Modelfile but wonder if it can be setup to also retrieve information from other systems and insert them into the LLM’s context window via a
by skanga 3y ago
I love the idea of a Modelfile but wonder if it can be setup to also retrieve information from other systems and insert them into the LLM’s context window via a prompt. This gives LLMs information beyond what was provided in their training data, which is necessary for almost every enterprise use case. Examples include data from current web pages, data from SaaS apps like Confluence or Salesforce, and data from documents like sales contracts and PDFs.
See https://github.com/psychic-api/rag-stack https://github.com/psychic-api/rag-stack for an example. Note that most of the above verbiage also comes from there!