2 ms·
The claim that it is better than GPT3.5, in practice, should be taken with a grain of salt, since the benchmarks themselves aren't... ideal. Despite the questi
by i8comments 3y ago
The claim that it is better than GPT3.5, in practice, should be taken with a grain of salt, since the benchmarks themselves aren't... ideal.
Despite the questionable marketing claim, it is a great LLM for other reasons.
- moffkalast 3y agoPlus benchmarks are typically ran from the API, using a tagged version of 3.5-turbo and not the whatever extra tuning and prompt magic ChatGPT as a frontend has to actually get the better results that people see in practice. On the other hand, if the base instruct model is good enough to roughly match it then the fine tunes will be interesting for sure.