3 ms·
> It's not verifying the output after it's done, it's constraining the output as it's generated. It is verifying, by filtering only tokens that allowed by the
by karmasimida 3y ago
> It's not verifying the output after it's done, it's constraining the output as it's generated.
It is verifying, by filtering only tokens that allowed by the grammar. I think we are talking about the same thing.