You can just force it to output into a specified BNF grammar this is quite easy https://www.imaurer.com/llama-cpp-grammars/ https://www.imaurer.com/llama-cpp-g

You can just force it to output into a specified BNF grammar this is quite easy https://www.imaurer.com/llama-cpp-grammars/ https://www.imaurer.com/llama-cpp-grammars/