3 ms·
Why should Twitter care about AI scraping, beyond the load it causes to their servers? Scraping isn't new, and I don't think the overall rate of scraping has ch
by Retr0id 3y ago
Why should Twitter care about AI scraping, beyond the load it causes to their servers? Scraping isn't new, and I don't think the overall rate of scraping has changed much since the advent of AI - it only needs to be scraped once, then it's in a dataset (I don't have any stats to back this up, though)
- a_bonobo 3y agoIf you have a company building AI on top of Twitter's data, it could've been a company Twitter itself could've built. It's the feeling of lost money for them.
- rchaud 3y agoThe API has been wide open until 2023, so if there was anything of value, I think we would have seen something by now. Musk would also have been focused on that instead of trying to become WeChat US.
- lenkite 3y agoAccording to Musk, below: Almost every company doing AI, from startups to some of the biggest corporations on Earth, was scraping vast amounts of data,” Musk said. “It is rather galling to have to bring large numbers of servers online on an emergency basis just to facilitate some AI startup’s outrageous valuation. Several hundred organizations (maybe more) were scraping Twitter data extremely aggressively, to the point where it was affecting the real user experience." To address extreme levels of data scraping & system manipulation, we’ve applied the following temporary limits: - Verified accounts are limited to reading 6000 posts/day - Unverified accounts to 600 posts/day - New unverified accounts to 300/day