5 ms·
I've run into the same issue, but you can turn it into an advantage if you are careful enough. Basically, give the LLM a schema that is loose enough for the LL
by com2kid 3y ago
I've run into the same issue, but you can turn it into an advantage if you are careful enough.
Basically, give the LLM a schema that is loose enough for the LLM to expand where it feels expansion is needed. Saying always "return a number" is super limiting if the LLM has figured out you need a range instead. Saying "always populate this field" is silly because sometimes the field doesn't need to be populated.