3 ms·
For those who like testing smaller local models, there is a tool in LangChain called Routing and in LlamaIndex called a "router query engine" which achieve a si
by ceroxylon 2y ago
For those who like testing smaller local models, there is a tool in LangChain called Routing and in LlamaIndex called a "router query engine" which achieve a similar thing:
https://python.langchain.com/v0.1/docs/use_cases/query_analysis/techniques/routing/ https://python.langchain.com/v0.1/docs/use_cases/query_analy...
https://docs.llamaindex.ai/en/stable/examples/query_engine/RouterQueryEngine/ https://docs.llamaindex.ai/en/stable/examples/query_engine/R...
- danlenton 2y agoThanks for sharing! These are useful toos, but they are a bit different, more based on similarity search in prompt space (a bit like semantic router: https://github.com/aurelio-labs/semantic-router https://github.com/aurelio-labs/semantic-router). Our router uses a neural network for the routing decisions, and it can be trained on your own prompts [https://youtu.be/9JYqNbIEac0 https://youtu.be/9JYqNbIEac0]. We're also adding support for on-prem deployment soon!