3 ms·
You can use outlines https://github.com/outlines-dev/outlines https://github.com/outlines-dev/outlines to let models generate with correct syntax.
by sanxiyn 3y ago
You can use outlines https://github.com/outlines-dev/outlines https://github.com/outlines-dev/outlines to let models generate with correct syntax.
- pamelafox 3y agoThanks! I havent had to use a syntax-enforcing framework with gpt-35, I’ll try outlines and guidance out to see if they help enforce syntax for the locally runnable models.