3 ms·
Has anyone done such fine tuning on llama though? Afaik most projects like llama.cpp use grammars instead.
by behnamoh 3y ago
Has anyone done such fine tuning on llama though? Afaik most projects like llama.cpp use grammars instead.
- Arctic_fly 3y agoYep! The linked notebook includes an example of exactly that (fine-tuning a 7b model to match the syntax of GPT-4 function call responses): https://github.com/OpenPipe/OpenPipe/blob/main/examples/classify-recipes/3-evaluate.ipynb https://github.com/OpenPipe/OpenPipe/blob/main/examples/clas...
- behnamoh 3y agoThanks!