great tool and as someone mentioned there are quite a few AI products/libraries that accomplish this. The main challenge for production settings 1) soon becom

great tool and as someone mentioned there are quite a few AI products/libraries that accomplish this. The main challenge for production settings 1) soon becomes optimizing the latency for each step and 2) dealing with complex queries at a reasonable cost (GPT-4 is bit expensive at scale) We evaluated multiple options and settled on GPT-3Turbo in the short term. However we are not happy with the latency, especially if you create an agentic solution.