That is the accuracy of the non-finetuned model i.e. mpt-7b. Once finetuned, it can get around 30% accuracy on 0-shot. Not sure what 8-shot performance is for t

That is the accuracy of the non-finetuned model i.e. mpt-7b. Once finetuned, it can get around 30% accuracy on 0-shot. Not sure what 8-shot performance is for the finetuned model. https://arxiv.org/pdf/2310.06927.pdf https://arxiv.org/pdf/2310.06927.pdf