3 ms·
The 13B Llama 2 model is not that good compared to the best ones. Maybe it was easier for them to fine tune?
by petters 3y ago
The 13B Llama 2 model is not that good compared to the best ones. Maybe it was easier for them to fine tune?
- ca_tech 3y agoThey do mention that their expectation is that the 70B model will provide even better performance. I expect that you are correct and that they determined the 13B was capable enough to serve as a base model. Why incur additional training time before getting preliminary results.