6 ms·
Do any LLMs support constrained generation of newline delimited json? Or have you found that they're generally reliable enough that you don't need to do constra
by rictic 1y ago
Do any LLMs support constrained generation of newline delimited json? Or have you found that they're generally reliable enough that you don't need to do constrained sampling?
- sprobertson 1y agonot for the standard hosted APIs using structured output or function calling, best you can get is an array