3 ms·You can enforce grammar. Llama.cpp can do that, without any need to change models.by rini17 11mo agoYou can enforce grammar. Llama.cpp can do that, without any need to change models.