3 ms·
What kind of damage is done by constraining token generation to valid JSON?
by noahbp 2y ago
What kind of damage is done by constraining token generation to valid JSON?
- snovv_crash 2y agoYeah, from my experience if you prompt something like: respond in JSON in the following format: {"spam_score": X, "summary": "..."} and _then_ you constrain the output to json, the quality of the output isn't affected.