3 ms·
How to make LangChain agents faster?
Langchain agents works not bad with multiple tools however until the final output is given, the response times are usually around 40 seconds. Has anyone tried out an architecture that made them much more faster without compromising on the output quality?
- foolishbard 3y agoI have been using sllim (note: I am the author) which allows me to easily parallelize the network requests to speed up agents. It is only helpful with distributed chains (like tree of thoughts) and doesn't help with sequential chains. link: https://news.ycombinator.com/item?id=36913492 https://news.ycombinator.com/item?id=36913492