4 ms·
Elaborating on that: 1. The founding team’s track record and credentials. 2. there is currently no major independent player in the EU of OpenAI’s scale. 3. E
by sheepscreek 3y ago
Elaborating on that:
1. The founding team’s track record and credentials.
2. there is currently no major independent player in the EU of OpenAI’s scale.
3. EU entities will prefer working with an EU based partner over OpenAI.
Having the LLaMA tech lead is a win. Having someone ex-OpenAI can bolster their position even more.
Now the anti-thesis:
1. It is gradually becoming apparent that models trained on high quality data don’t need to be so big.
2. phi-1 from Microsoft is < 1.3B parameters and can compete with GPT-3.5 reasonably well.
3. In addition, it seems GPT-4 is not one model, but a collection of 8 models trained on different datasets. Along with the above, all of a sudden - training GPT-4 like models is coming within the reach of an average person.
All in - nobody has won this yet. And Meta open-sourcing their research was the cleverest strategic play that I’ve seen in a while. It has done so much to weaken their competitors while really pushing AI forward in an open way (so much for “OpenAI”).