4 ms·
> or attempted compilation This specifically is a solvable problem with grammar constraints on the token output. You can give LLM no other option than syntacti
by brucethemoose2 3y ago
> or attempted compilation
This specifically is a solvable problem with grammar constraints on the token output. You can give LLM no other option than syntactically correct C code, chess moves or whatever with the right grammar restriction.
Its one of the (IMO) biggest revolutions in the LLM space that precisely no one uses.