3 ms·
I don't think this is the only factor but I suspect part of it is because GPT-4 had access to better datasets. After ChatGPT came out a lot of the places GPT w
by f0e4c2f7 3y ago
I don't think this is the only factor but I suspect part of it is because GPT-4 had access to better datasets.
After ChatGPT came out a lot of the places GPT was assumed to be trained on (reddit, twitter) started closing their APIs.
This alone represents a pretty significant moat.
- seeknotfind 3y agoReddit was still pretty easy to get last summer. I saved a copy. Twitter has never really been easy. Some data sets are getting locked down, but you can still get them if you have enough motivation. I think the technical skill first and compute access are bigger hurdles.