3 ms·
In the lawsuit, NYT pointed out that their articles are the third-most used source in GPT-3, behind Wikipedia and the US patent office. We don't know what they
by nicklecompte 3y ago
In the lawsuit, NYT pointed out that their articles are the third-most used source in GPT-3, behind Wikipedia and the US patent office. We don't know what they used for GPT-4 but I imagine NYT is still very prominent. High-quality newspaper articles are valuable for training LLMs because they contain good prose and an enormous variety of factual information. They can't be replaced by throwing in a bunch of Reddit comments and hoping for the best.
"NYT bits of the corpus" is understating things - I imagine getting rid of NYT articles would significantly impact the overall quality of GPT-4's responses in many unexpected domains.
- vidarh 3y agoI very much doubt it'd be a problem. OpenAI's valuation is such a large multiple of NYT that they can afford to buy out a dozen or so publishers of NYT's valuation to get content to replace (or "just" license content from far more) if NYT itself isn't willing to play ball cheaply enough. The NYT might be better than average, but it's not so special that you can't replace it. The long-term effect if NYT wins this case will be that the "established" players and companies with deep pockets will get a massive moat protecting them against open models and new entrants - in the long run it might well be well worth whatever a loss will cost them.