3 ms·
There's no moat in AI. AI feeds on data, and the kind of data it feeds on is necessarily massive publicly scraped data. Deployment has to be done on a large sc
by visarga 4y ago
There's no moat in AI. AI feeds on data, and the kind of data it feeds on is necessarily massive publicly scraped data.
Deployment has to be done on a large scale to recuperate the training costs. You can't hide it. By having API access the model discloses its abilities and can even be used to improve the training set of your competition.
And models are compact, you can put SD on a DVD, but the original training set was 100,000 times larger. You can train a 13B language model from 1T tokens. You can download, save and share a GPT4 but you can't "download a Google" (remember what happened to the LLaMA model and 4chan). AI models are self contained pieces of data and code.
So my conclusion is that AI will spread wide and reverse the centralisation trend we have had in the last 20 years.