4 ms·
Why not use the finite state machine logits filter trick for controlling output format? It seems to work pretty well for JSON
by KRAKRISMOTT 3y ago
Why not use the finite state machine logits filter trick for controlling output format? It seems to work pretty well for JSON
- antman 3y agoWhat is that? Sounds useful
- evrimoztamur 3y agoI think he's referring to https://news.ycombinator.com/item?id=37125118 https://news.ycombinator.com/item?id=37125118 Controlling token outputs to match a regex generates valid JSON 100% of the time!