Looks like it actually changes how you do token generation to conform to a given context-free grammar. It's a way to structure how you sample from the model rat

Looks like it actually changes how you do token generation to conform to a given context-free grammar. It's a way to structure how you sample from the model rather than a tweak to the prompt, so it's more efficient and guarantees that the output matches the formal grammar. There's a reference to the paper that describes the method at the bottom of the README: https://arxiv.org/pdf/2307.09702 https://arxiv.org/pdf/2307.09702