4 ms·
Open LLMs can use grammar-based sampling to guarantee syntactically correct JSON is produced, surprised OpenAI never incorporated anything like that.
by logicchains 3y ago
Open LLMs can use grammar-based sampling to guarantee syntactically correct JSON is produced, surprised OpenAI never incorporated anything like that.
- rolisz 3y agomy concern with grammar based sampling is that it makes the model dumber: after all, you are forcing it to say something else than what it thought would be best.
- remilouf 3y agoLooks like it’s quite the opposite: http://blog.dottxt.co/performance-gsm8k.html http://blog.dottxt.co/performance-gsm8k.html