4 ms·
> We had issues with consistent JSON ouput [solved] It says the JSON output is constrained via their platform (on la Plateforme). Does that mean JSON output i
by neillyons 2y ago
> We had issues with consistent JSON ouput [solved]
It says the JSON output is constrained via their platform (on la Plateforme).
Does that mean JSON output is only available in the hosted version? Are there any small models that can be self hosted that output valid JSON.
- ajcp 2y ago> Does that mean JSON output is only available in the [self]-hosted version? I would assume so. They probably constrain JSON output so that the JSON response doesn't bork the front-end/back-end of la Plateforme itself as it moves through their code back to you.
- PhilippGille 2y ago> Are there any small models that can be self hosted that output valid JSON. Yes, for example this one is optimized for function calling and JSON output: https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B