4 ms·

Without exception, LLM frontends out there that use vector search simply do a query and hope for the best. The reality is that the answer may not be in the resu

by _pdp_ 3y ago

Without exception, LLM frontends out there that use vector search simply do a query and hope for the best. The reality is that the answer may not be in the result. It is a hard problem to solve. We are at least 1-2 stepping stones away from having a solution that actually works!

danielbln 3y ago
You can do a lot with hybrid approaches, where you mix and match semantic search results with classic text based search. In addition, depending on what kind of knowledge you pull in, the LLM pretraining can often fill the gaps pretty well even if the retrieval augmentation isn't ideal. But yes, it's still pretty fuzzy, though it works more often than not.
- kordlessagain 3y ago
  Like this: https://GitHub.com/featurebasedb/DoctorGPT https://GitHub.com/featurebasedb/DoctorGPT