>I can make GPT4 return valid JSON simply by providing examples in the system message. This works nine times out of ten But you can do both. For my current use

>I can make GPT4 return valid JSON simply by providing examples in the system message. This works nine times out of ten But you can do both. For my current use case of extracting information from articles, I have a json schema + one/two example articles along with their correct answers. This increases token costs but 3.5 is so cheap that it doesn't matter and for 4 you can use batching to decrease token cost per article.