3 ms·
> note: the model may generate invalid JSON or hallucinate parameters This seems like it could be a really big problem for this feature.
by tmaly 3y ago
> note: the model may generate invalid JSON or hallucinate parameters
This seems like it could be a really big problem for this feature.
- roughly 3y agoThe Langchain package does something similar to this and has a feature to combat that kind of thing that basically feeds the invalid input back into the bot and says “you were asked for x but gave this, please correct it” - it’s shockingly effective.
- Spivak 3y agoWhich is surprising since jsonformer exists and the same approach works with the text-completion API just fine.