43 ms·
Considering that OpenAI is barely able to stay ahead of open-source, and in some cases has fallen behind (i.e. 4o vs DeepSeek V3), I think the data moat doesn't
by reissbaker 2y ago
Considering that OpenAI is barely able to stay ahead of open-source, and in some cases has fallen behind (i.e. 4o vs DeepSeek V3), I think the data moat doesn't really exist. And the difference between 4o and o1 isn't training on more data: quite famously it's scaling test-time compute, not scaling training.
"The data is the moat" was a pretty common belief a few years ago, but not anymore.
- rad_gruchalski 2y agoAnd you think they throw in $500B because they are altruistic?