4 ms·
>Or would it be better to have the user highlight the text they want changed which then gives them the option to direct how to change it with natural language?
by bsenftner 2y ago
>Or would it be better to have the user highlight the text they want changed which then gives them the option to direct how to change it with natural language?
That's exactly what I have: the user selects what they want modified, uses the "chat text area" to request the change, the entire document is sent in (for prose consistency) with the selection identified and the change is performed. If no selection is, the change request is applied to the entire document in context-output-size aware chunks.
The RAG interface is not the only document query interface, but is the one preferred for finding information inside documents and discussing that information in large documents. My RAG implementation is a bit more than "just RAG", I use the document to generate a subject matter expert in the subject matter of the document, and that generated agent is who the end-user converses, along with the retrieved document information. So, in a way, my RAG is with the document, and an agent generated from the document, along with a context sensitive "professional communicator agent" whose job is to fill in the context breaks between the different RAG snippets, which reduces the fractured nature of the RAG snippets, lending towards better, deeper, more nunaced answers.