4 ms·
Figure 2 in our paper (https://arxiv.org/abs/2307.09702 https://arxiv.org/abs/2307.09702) shows the difference between guidance and outlines to generate a seque
by remilouf 3y ago
Figure 2 in our paper (https://arxiv.org/abs/2307.09702 https://arxiv.org/abs/2307.09702) shows the difference between guidance and outlines to generate a sequence that is valid to a regex. Jsonformer uses the same technique as guidance. Extrapolate this to several fields.
Note that we still need to manage the KV cache in outlines. It’s a small interface change that will be made this week hopefully, but we’ve been focusing on constrained generation so far.
- Der_Einzige 3y agoSad to see that my related work on token-level constrained text generation is not cited in the paper: https://github.com/Hellisotherpeople/Constrained-Text-Generation-Studio https://github.com/Hellisotherpeople/Constrained-Text-Genera... https://aclanthology.org/2022.cai-1.2/ https://aclanthology.org/2022.cai-1.2/
- remilouf 3y agoWe're unfortunately only human and didn't catch every single paper on the topic while writing the draft. Thanks for bringing it to our attention.