4 ms·
Fair enough. I think that many would like to have their own proprietary models, but for now, these "web scale" datasets really only come from scraping the inter
by version_five 3y ago
Fair enough. I think that many would like to have their own proprietary models, but for now, these "web scale" datasets really only come from scraping the internet. Companies can do their own cleaning and whatnot, but the data distribution still largely reflects what's on the internet because that's all there is.
To your point though, three are definitely some proprietary pockets, like the Shutterstock/openai thing. Or the various RL layers ala chatgpt. But a lot of the value there is in the labeling, and I expect we'll see more competing versions that are open (we already are)
- cs702 3y agoI hope you're right :-)