4 ms·
Who has analyzed the failure modes of this tool? In particular, what happens when the LLM makes mistakes? Does this lead to malformed or unpredictable API calls
by xpe 3y ago
Who has analyzed the failure modes of this tool? In particular, what happens when the LLM makes mistakes? Does this lead to malformed or unpredictable API calls? What are the risks?
- deleted 3y ago[deleted]
- joshuanapoli 3y agoSeems like the AI feature is optional, and it defines a workflow. So the user has a chance to review and debug the workflow before using it, similar to if they had created it manually.
- jsajal1993 3y agoHi, this is the author of the tool here. What joshuanapoli said is absolutely true, "user has a chance to review and debug the workflow before using it" but majorly we have put guardrails that filters out the part of the output that LLM hallucinated or is incorrect