4 ms·
What is grammar support? I've seen that mentioned several times now. Does it allow to restrict the output to a given template, or am I totally wrong there?
by Tomte 3y ago
What is grammar support? I've seen that mentioned several times now. Does it allow to restrict the output to a given template, or am I totally wrong there?
- biwills 3y agoYes. Here's a quick rundown of grammar in llama.cpp (link on the docs of faraday.dev which runs llama.cpp under the hood) https://docs.faraday.dev/character-creation/grammars https://docs.faraday.dev/character-creation/grammars