3 ms·
I may have missed the detail, but it also expects the pytorch conversion rather than original LLaMa model.
by hotpathdev 4y ago
I may have missed the detail, but it also expects the pytorch conversion rather than original LLaMa model.
- zhwu 4y agoYes, you need to convert the original LLaMA model to the huggingface format, according to https://github.com/lm-sys/FastChat#vicuna-weights https://github.com/lm-sys/FastChat#vicuna-weights and https://huggingface.co/docs/transformers/main/model_doc/llama https://huggingface.co/docs/transformers/main/model_doc/llam...