4 ms·
Only the bottom 2 out of top 10 are open-source and available for commercial use. So if you want to use an open-source LLM for your commercial product, be aware
by exizt88 3y ago
Only the bottom 2 out of top 10 are open-source and available for commercial use. So if you want to use an open-source LLM for your commercial product, be aware that your competitors who use proprietary LLMs through APIs will outperform you dramatically. Or am I missing something?
- netsec_burn 3y agoWhat you're missing is not reflected on the leaderboard right now, Guanaco 65B.
- EvgeniyZh 3y agoGuanaco is LLaMA tune and thus is irrelevant for commercial use, isn't it?
- netsec_burn 3y agoAh true! It isn't for commercial use.
- version_five 3y agoI'd say your missing the importance of not being bound to a proprietary model, and of not having to explain to your customers why you send their data to a third party. It's still early days - definitely if you need the sota performance this second, you don't have any options. But in the fairly near term, I see no evidence that the proprietary generic models will keep their leads in a way that's meaningful for commercial products. Do you?
- Garcia98 3y agoNote that the FLAN-T5 variant in 10th place is 3B parameters large, there is another FLAN-T5 variant that has 11B parameters that should perform better (and the fact that a 3B model is able to compete with Alpaca-13B is impressive by itself).