4 ms·
Show HN: SynapseKit – Async-native Python framework for LLM pipelines and agents
- aminau 6mo ago[dead]
- aminau 6mo agohttps://www.reddit.com/r/LangChain/comments/1sm3g2q/i_tested_async_performance_across_langchain/?utm_source=post_insights&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button https://www.reddit.com/r/LangChain/comments/1sm3g2q/i_tested...
- grimmai143 6mo agoAsync is definitely the right approach for this, but how are you handling the event loop blocking if a local model takes way too long to generate a heavy sequence?
- aminau 6mo ago[dead]