3 ms·
I see grammar constrained generation for 2 major advantages: 1. It consumes fewer tokens, no need to add too many examples into the prompt. 2. It suffers less
by karmasimida 3y ago
I see grammar constrained generation for 2 major advantages:
1. It consumes fewer tokens, no need to add too many examples into the prompt.
2. It suffers less from the forgetting issue.
Another minor advantage is you can control precisely where your desired output to begin with.
But overall, those are nice perks not too substantial IMO.