4 ms·
JSON mode and function-calling with a JSON schema in the OpenAI API.
by bugglebeetle 3y ago
JSON mode and function-calling with a JSON schema in the OpenAI API.
- WhitneyLand 3y agoRight, but which model? It makes a huge difference.
- bugglebeetle 3y agoI’ve been using OpenChat 3.5 1210 most recently. Before that, Mistral-OpenOrca. Both return JSON more consistently than gpt-3.5-turbo.
- airstrike 3y agogpt-3.5-turbo is not the benchmark
- bugglebeetle 3y agoI don’t know what point you’re trying to make. They also return JSON more consistently than gpt-4, but I don’t use that because it’s overkill and expensive for my text extraction tasks.
- WhitneyLand 3y agoBecause people have different interests and want to hear your results for different reasons. Some want to consider results relative to cost, and some are interested only in how it compares to SOTA.
- bugglebeetle 3y agoI mean, sure, but the parent should also just explicitly state what it is they were asking or claiming. I’ve answered every question asked. Making vague declarations about something not being “the benchmark,” while not stating what you think “the benchmark” should be, is unhelpful.