This is exciting, we built a similar tool[1] recently specifically targeted at constraining llama output to match a TypeScript interface. I firmly believe that

This is exciting, we built a similar tool[1] recently specifically targeted at constraining llama output to match a TypeScript interface. I firmly believe that output format guarantees are going to be important for real (non-toy) decades for LLMs [1] https://github.com/ggerganov/llama.cpp/discussions/2494 https://github.com/ggerganov/llama.cpp/discussions/2494