10 ms·
> I wonder why? It seems to work pretty well for me. I read this as "what we do works just fine to not need to use JSON mode". We're in the same boat at my com
by phillipcarter 3y ago
> I wonder why? It seems to work pretty well for me.
I read this as "what we do works just fine to not need to use JSON mode". We're in the same boat at my company. Been live for a year now, no need to switch. Our prompt is effective at getting GPT-3.5 to always produce JSON.
- Kiro 3y agoThere's nothing to switch to. You just enable it. No need to change the prompt or anything else. All it requires is that you mention "JSON" in your prompt, which you obviously already do.
- ShamelessC 3y agoI think that’s only true when using ChatGPT via the web/app, not when used via API as they likely are. Happy to be corrected however.
- throwup238 3y agoIf you don’t know, why speculate on something that is easy to look up in documentation? https://platform.openai.com/docs/guides/text-generation/json-mode https://platform.openai.com/docs/guides/text-generation/json...
- phillipcarter 3y agoYou do need to change the prompt. You need to explicitly tell it to emit JSON, and in my experience, if you want it to follow a format you need to also provide that format. I've found that this is pretty simple to do when you have a basic schema and there's no need to define one and enable function calling. But in one of my cases, the schema is quite complicated, and "model doesn't produce JSON" hasn't been a problem for us in production. There's no incentive for us to change what we have that's working very well.