4 ms·

Does anyone maintain a list of ai products developed without scraping?

• flir 2y ago
  {}
• xena 2y ago
  I don't think it's possible to develop a frontier model without mass scraping. The economics simply don't add up. You need at least 10 trillion tokens to make an 8 billion parameter model. 10 trillion tokens is something like 40 terabytes. You simply can't get 40 terabytes of text without mass scraping.
  • mdp2021 2y ago
    > You need at least 10 trillion tokens to make an 8 billion parameter model Are you sure it is not just very inefficient?
    • GTP 2y ago
      I'm not an AI expert, but it seems to me that the common consensus is that current LLMs are quite inefficient and that there's room for improvement.
• jsheard 2y ago
  I don't know about text models, but most of the big stock photo companies are offering image generators trained on their own libraries rather than scraped images. Adobe, Getty, Shutterstock, iStock, possibly more. They're positioning themselves as the safe option while the legality of scraping is still up in the air.