2 ms·
Just one question. If I'm running a local model, can I do something other than just a context free grammar? Does it makes sense to have something more general,
by nextaccountic 4mo ago
Just one question. If I'm running a local model, can I do something other than just a context free grammar? Does it makes sense to have something more general, or it would be just too slow?
I guess the only hard constraint is to not have backtracking, right? To not waste previously emitted tokens