3 ms·
Is Python execution even a rounding error in the full execution time for a LangChain flow?
by turnsout 2y ago
Is Python execution even a rounding error in the full execution time for a LangChain flow?
- AStrangeMorrow 2y agoI’d wager it can probably a few percents of the full runtime. But no matter the variation in the time it takes for LLMs to generate outputs (depending on the nb of tokens produced/input size) likely drowns it completely. Like 5s+/-1s vs 4.95s+/-1s