3 ms·
I have had a lot of success using BoundaryML (https://www.boundaryml.com/ https://www.boundaryml.com/) for this. They have also been super responsive for any of
by agtech_andy 2y ago
I have had a lot of success using BoundaryML (https://www.boundaryml.com/ https://www.boundaryml.com/) for this. They have also been super responsive for any of my questions.
- aaronvg 2y agothanks for the shoutout, we benchmarked our approach against other function-calling techniques and we've been able to beat all other approaches every time (even by 8%!) just by getting better at parsing the data and representing schemas with less tokens using type definitions instead of json schema. You can take a look at our BFCL results on that site or the github: https://github.com/BoundaryML/baml https://github.com/BoundaryML/baml We'll be publishing our comparison against OpenAI structured outputs in the next 2 days, and a deeper dive into our results, but we aim to include this kind of constrained generation as a capability in the BAML DSL anyway longterm!