tholor

4 ms·

1. 1.▲
   by tholor 3y ago

   Yes! https://github.com/deepset-ai/haystack
2. 2.▲
   by tholor 4y ago

   Haystack Agents are designed in a way so that you can easily use them with different LLM providers. You just need to implement one standardized wrapper class for your modelprovider of choice ( https://github.com/deepset-ai&#x
3. 3.▲
   by tholor 4y ago

   That's right. If you want to ask questions about "general public knowledge", a plain LLM will know anyway and would not need tools. However, for many use cases you need data from your private CRM / a SQL db / a priv
4. 4.▲
   by tholor 4y ago

   Haystack's agent is indeed using the approach suggested in the ReAct paper
5. 5.▲
   by tholor 5y ago

   The demo corpus there just contains documents about countries and capital cities. So you could try asking questions like "What's the climate of Beijing?" or "How many people live in the capital of the US?".
6. 6.▲
   by tholor 5y ago

   Semantic document search is one of the core use cases we see in the community (besides Question Answering) and Haystack was pretty much started because we saw that you need much more than just models. It's so much pain to integrate mod
7. 7.▲
   by tholor 5y ago

   Yep, you want a GPU for many of the models. However, then subsecond queries are easy to achieve. See benchmarks: https://haystack.deepset.ai/benchmarks/latest