7 ms·
100% have observed the same over many tests. No loss in fidelity when responding in spoken language style of formatting but using json is disastrous.
by infecto 3y ago
100% have observed the same over many tests. No loss in fidelity when responding in spoken language style of formatting but using json is disastrous.
- nouri 3y agoUsing OpenAI Function Calls or asking for JSON in the prompt?
- infecto 3y agoI have noticed it in both but have been working with json output before function calling was introduced so I have more evidence on that side. The times I have tried to implement it in a function call I was equally unimpressed with it.
- speedgoose 3y agoWhile not ideal, could a workaround be to ask in spoken language first, and then ask to format it in JSON?
- infecto 3y agoThat’s what we have been doing. Two passes. The task and then the format.