4 ms·

You might be trying to solve problems that they don't really have (but think they have), or you're solving them in the wrong way. For example, is a RAG chatbot

by afro88 2y ago

You might be trying to solve problems that they don't really have (but think they have), or you're solving them in the wrong way. For example, is a RAG chatbot the right way to get the information they need from documents, or do they want executive summaries of the document from different points of view that they almost always need to consider it from? Is a chat assistant that you have to talk to to make modifications to a document the right choice? Or would it be better to have the user highlight the text they want changed which then gives them the option to direct how to change it with natural language?

shermantanktop 2y ago
Sounds like this is third party product craziness.
bsenftner 2y ago
>Or would it be better to have the user highlight the text they want changed which then gives them the option to direct how to change it with natural language? That's exactly what I have: the user selects what they want modified, uses the "chat text area" to request the change, the entire document is sent in (for prose consistency) with the selection identified and the change is performed. If no selection is, the change request is applied to the entire document in context-output-size aware chunks. The RAG interface is not the only document query interface, but is the one preferred for finding information inside documents and discussing that information in large documents. My RAG implementation is a bit more than "just RAG", I use the document to generate a subject matter expert in the subject matter of the document, and that generated agent is who the end-user converses, along with the retrieved document information. So, in a way, my RAG is with the document, and an agent generated from the document, along with a context sensitive "professional communicator agent" whose job is to fill in the context breaks between the different RAG snippets, which reduces the fractured nature of the RAG snippets, lending towards better, deeper, more nunaced answers.
ooterness 2y ago
> Or would it be better to have the user highlight the text they want changed which then gives them the option to direct how to change it with natural language? Users could also highlight the text they want changed, then skip the middleman by typing in the new text themselves. Not sure how to monetize this.

by afro88 2y ago

shermantanktop 2y ago

Sounds like this is third party product craziness.

bsenftner 2y ago

>Or would it be better to have the user highlight the text they want changed which then gives them the option to direct how to change it with natural language? That's exactly what I have: the user selects what they want modified, uses the "chat text area" to request the change, the entire document is sent in (for prose consistency) with the selection identified and the change is performed. If no selection is, the change request is applied to the entire document in context-output-size aware chunks. The RAG interface is not the only document query interface, but is the one preferred for finding information inside documents and discussing that information in large documents. My RAG implementation is a bit more than "just RAG", I use the document to generate a subject matter expert in the subject matter of the document, and that generated agent is who the end-user converses, along with the retrieved document information. So, in a way, my RAG is with the document, and an agent generated from the document, along with a context sensitive "professional communicator agent" whose job is to fill in the context breaks between the different RAG snippets, which reduces the fractured nature of the RAG snippets, lending towards better, deeper, more nunaced answers.

ooterness 2y ago

> Or would it be better to have the user highlight the text they want changed which then gives them the option to direct how to change it with natural language? Users could also highlight the text they want changed, then skip the middleman by typing in the new text themselves. Not sure how to monetize this.