3 ms·
Is there a reason for why you wouldn't use something like Outlines or Xgrammar to force a grammar on the output?
by huevosabio 2y ago
Is there a reason for why you wouldn't use something like Outlines or Xgrammar to force a grammar on the output?
- aaronvg 2y agoSometimes you don't have access to a model, so this approach still works in that scenario. We also have several users that have anecdotally told us they get worse results using constrained grammar solutions.