4 ms·
> I'm trying to work on getting llama to output according to a user defined tagging vocabulary/taxonomy and ideally learn from manual classifications. Kind of a
by Eisenstein 2y ago
> I'm trying to work on getting llama to output according to a user defined tagging vocabulary/taxonomy and ideally learn from manual classifications. Kind of a work in progress there.
Good luck with that. The only thing that I found that works is using gbnf to force it, which slows inference down considerably.