2 ms·
If you're using llama.cpp there is also a tool to convert Typescript interfaces to the BNF grammar used to restrict the output tokens: https://grammar.intrinsi
by throwup238 3y ago
If you're using llama.cpp there is also a tool to convert Typescript interfaces to the BNF grammar used to restrict the output tokens: https://grammar.intrinsiclabs.ai/ https://grammar.intrinsiclabs.ai/