3 ms·
can someone explain the PEFT vs Zero-shot results to me? (in the table) How can Llama go from 1.8 to around 68?
by randomcatuser 3y ago
can someone explain the PEFT vs Zero-shot results to me? (in the table) How can Llama go from 1.8 to around 68?
- deleted 3y ago[deleted]
- kristjansson 3y agoAIUI they (1) finetuned LLaMA on 75B tokens of medical papers, and called the resulting model PMC-LLaMA, (2) finetuned that model on task-specifc data, then (3) separately finetuned the base model they started with in (1) on the same task specific data for comparison. So, they're reporting 6 separate conditions: {LLaMA, PMC-LLaMA} x {Zero-shot, Finetune, PEFT}. Could definitely use some more exposition around that though.