5 ms·
Small Nit: "This grammer can be used during LLMs generation." I didn't know Llama.cpp had this grammar feature, so this is interesting.
by idkyall 3y ago
Small Nit: "This grammer can be used during LLMs generation."
I didn't know Llama.cpp had this grammar feature, so this is interesting.
- codethief 3y agoIt's a relatively new feature, see https://github.com/ggerganov/llama.cpp/pull/1773 https://github.com/ggerganov/llama.cpp/pull/1773
- tarrekshaban 3y agoFixed! Thanks.