3 ms·
This is not their "entire game". It's just the current state of cutting edge AI. Transformers and deep neural networks work this way, and require a lot of data,
by proc0 2y ago
This is not their "entire game". It's just the current state of cutting edge AI. Transformers and deep neural networks work this way, and require a lot of data, and in the end it's just creating a blended space that can be searched.
I think in general people have opted for having free services in exchange for their data. Social media and online ads received no pushback from people, and everyone was and is more than happy to give away their data in exchange for a service. So this ship has sailed, so to speak, and now there is no infrastructure to properly credit people's data contribution, and so OpenAI is just walking down the beaten path and applying it to current AI tech.
OpenAI is doing what most social media has already done, which is take people's data and provide a product for cheap. I would assume if they were forced to disclose and compensate every single piece of data for training GPT4... first it might take many years, and second it would make the product too expensive and therefore not worth the effort.