3 ms·

I agree with you. For business applications, context window is more important than any extra reasoning ability. I can load up nearly all business documents, reg

• akira2501 2y ago
  > and the responses are accurate If you knew this ahead of time then what value did it provide you? Put another way, once the counter party realizes that you've pushed this responsibility onto an LLM, aren't you worried that they could take advantage of this fact to produce intentionally misleading query results? In an adversarial world what long term value could possibly exist here?
  • manishsharan 2y ago
    >> If you knew this ahead of time then what value did it provide you? I think I should have clarified that the responses were accurate when we bench-marked them against RAG applications built on other LLMs. If the results had been poor or below a set threshold, the RAG application built on Gemini Pro would have been shelved. >> Put another way, once the counter party realizes that you've pushed this responsibility onto an LLM, aren't you worried that they could take advantage of this fact to produce intentionally misleading query results? This is an excellent point but inapplicable in our use case as this was only meant for internal users, who otherwise would be opening word and PDF documents and searching through them or relying on their own memory.